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Abstract. We construct a two-parameter family of actions a)k,a of the Lie algebra 5l(2, R) by 
differential-difference operators on \ {0). Here, k is a multiplicity-function for the Dunkl 
operators, and a > arises from the interpolation of the Weil representation of Mp(N, R) and 
the minimal unitary representation of 0{N + 1,2). We prove that this action cjk^a lifts to a 
unitary representation of the universal covering of 5L(2,R), and can even be extended to a 
holomorphic semigroup ^k,a- In the k = Q case, our semigroup generalizes the Hermite semi- 
group studied by R. Howe (a - 2) and the Laguerre semigroup by the second author with G. 
Mano {a - 1). The boundary value of our semigroup Qj. ^ provides us with {k, a)- generalized 
Fourier transforms ^k,a, which includes the Dunkl transform Slk {a - 2) and a new unitary 
operator {a - Y), namely a Dunkl-type generalization of the Hankel transform. We estab- 
lish the inversion formula, and a generalization of the Plancherel theorem, the Hecke identity, 
the Bochner identity, and a Heisenberg uncertainty principle for ,'^k,a- We also find explicit 
kernel functions for Q.k,a and ."^kM for a - 1 , 2 in terms of Bessel functions and the Dunkl 
intertwining operator 
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1. Introduction 

The classical Fourier transform is one of the most basic objects in analysis; it may be 
understood as belonging to a one-parameter group of unitary operators on L^(R^), and this 
group may even be extended holomorphically to a semigroup (the Hermite semigroup) I{z) 
generated by the self-adjoint operator A - ||jc||^. This is a holomorphic semigroup of bounded 
operators depending on a complex variable z in the complex right half-plane, viz. I(z + w) = 
I{z)I{w). The structure of this semigroup and its properties may be appreciated without any 
reference to representation theory, whereas the link itself is rich as was revealed beautifully 
by R. Howe [UTj in connection with the Schrodinger model of the Weil representation. 

Our primary aim of this article is to consider the Dunkl Laplacian A^ and to construct a 
deformation of the classical situation, namely, a generalization ^k,a of the Fourier transform, 
and the holomorphic semigroup J^k,a{z) with infinitesimal generator ||.x|p~''Aj: - ||jc||", acting 
on a concrete Hilbert space deforming L^(R^). We analyze these operators ^k,a and ^k,a{z) 
in the context of integral operators as well as representation theory. 

The deformation parameters in our setting consist of a real parameter a coming from the 
interpolation of the minimal unitary representations of two different reductive groups, and a 
parameter k coming from Dunkl's theory of differential-difference operators associated to a 
finite Coxeter group; also the dimension N and the complex variable z may be considered as 
a parameter of the theory. 

We point out, that already deformations with = are new and interpolate the minimal 
representations of two reductive groups Mp(n, R) and Ooin + 1, 2)~. The generalized Fourier 
transform ^k,a and the holomorphic semigroup J^kA^) also might provide interesting gener- 
alizations of classical pseudo-differential calculus and possibly new generators of stochastic 
processes. 
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In the diagram below we have summarized some of the deformation properties by indicat- 
ing the limit behaviour of the holomorphic semigroup ^k,a{z)\ it is seen how various previous 
integral transforms fit in our picture. In particular we obtain as special cases the Dunkl trans- 
form (a = 2, z = Y a-ndk arbitrary), the Hermite semigroup I(z) GOl [311 (q = 2. 
k = and z arbitrary), and the Laguerre semigroup ^\ {a = I, k = and z arbitrary). 
We feel that our framework sheds new light even on the theory of the Dunkl transform. 

The 'boundary value' of the holomorphic semigroup J^tA^) from Re z > to the imaginary 
axis gives rise to a one-parameter subgroup of unitary operators. The underlying idea may be 
interpreted as a descendent of Sato's hyperfunction theory ll53l and also that of the Gelfand- 
Gindikin program |[23l |29l l48l [55l for unitary representations of real reductive groups. The 
specialization yk.aij) will be called as a (k, (3)-generalized Fourier transform ^/.^ (up to a 
phase factor), which reduces to the Fourier transform (a = 2 and k = 0), the Dunkl transform 
^k(a = 2 and k arbitrary), and the Hankel transform (a = 1 and k = 0). 

Yet another specialization is to take = 1 and k = 0. This very special case gives the 

-model of the highest weight representations of the universal covering group of S L{2, R.), 
which was previously constructed by B. Kostant [42J and R. Rao [49| by letting 5I2 act as 
differential operators on the half-line. In particular, it was demonstrated that these actions 
integrate to a family of unitary representations with continuous parameter a of the group. 
Furthermore, the Weyl group element (z = j in our notation) gives the Hankel transform. 
Thus, the present article may be regarded also as a generalization of this one-dimensional 
classical setting to functions of variables, and even to a Dunkl deformation of the operators. 

The secondary aim of this article is to contribute the theory of special functions, in partic- 
ular orthogonal polynomials; indeed we derive several new identities, for example, the (k, a)- 
deformation of the classical Hecke identity (Corollary 5.20) where the Gaussian function and 
harmonic polynomials in the classical setting are replaced respectively with exp(-^||x||") and 
polynomials annihilated by the Dunkl Laplacian. Another example is the identity (I 4.41| ). 
which expresses an infinite sum of products of Bessel functions and Gegenbauer functions as 
a single Bessel functions. 

In the rest of Introduction we describe a little more the contents of this article. 

In Sections 1 . 1 and 1.2', without any reference to representation theory, we discuss our 
holomorphic semigroup J^/:,a(z) and {k, a)-generalized Fourier transforms ^k,a as a two-parameter 
deformation of the classical objects, i.e. the Hermite semigroup and the Euclidean Fourier 
transform. 

In Section 1 1.3', we introduce the basic machinery of the present article, namely, to construct 
triples of differential-difference operators generating the Lie algebra of S L(2, R), and see how 
they are integrated to unitary representations of the universal covering group. 

One further aspect of our constructions is the link to minimal unitary representations. For 
the specific two parameters {a,k) = (1,0) and (2,0), we are really working with representa- 
tions of much larger semisimple groups, and our deformation is interpolating between two 
different minimal representations for two different groups. We highlight on these hidden 
symmetries in Section 1.4, 

Let us also note that there is in our theory a natural appearance of some symmetries of 
the double degeneration of the double affine Hecke algebra (sometimes called the rational 
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Cherednik algebra), see Section 5.6, Here a = 2 and k arbitrary, and in particular, we recover 
the Hankel transform found by Cherednik. 




(k, a)-generalized Fourier transform ,^k,a 



(k, a)-generalized Laguerre semigroup yk,a(z) 



Dunkl transform 
fflQl 



Hermite semigroup I(z) 

mm 




Ai(z) 



Laguerre semigroup 
[31 



(see (5.1)) 



k^Q 



Fourier transform 



k^O 



Hankel transform 



'unitary inversion operator' 



the Weil representation of 

the metaplectic group Mp(N, R) 



the minimal representation of 
the conformal group 0{N +1,2) 



Diagram 1. Special values of holomorphic semigroup J^kAz) 



1.1. Holomorphic semigroup J^kAz) with two parameters k and a. 

Dunkl operators are differential-difference operators associated to a finite reflection group on 
the Euclidean space. They were introduced by C. Dunkl [10|. This subject was motivated 
partly from harmonic analysis on the tangent space of the Riemannian symmetric spaces, and 
resulted in a new theory of non-commutative harmonic analysis without 'Lie groups'. The 
Dunkl operators are also used as a tool for investigating an algebraic integrability property 
for the Calogero-Moser quantum problem related to root systems [25] . We refer to [.151 for 
the up-to-date survey on various applications of Dunkl operators. 

Our holomorphic semigroup yk.aiz) is built on Dunkl operators. To fix notation, let (£ be 
the Coxeter group associated with a root system ^ in BJ^ . For a £-invariant function k = (ka) 
(multiplicity function) on we write Ak for the Dunkl Laplacian on R.^ (see (2.10)). 
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We take a > to be a deformation parameter, and introduce the following differential- 
difference operator 

A,,, :=|W|2-"A,-|Wr. (1.1) 

Here, \\x\\ is the norm of the coordinate x 6 E.^, and \\x\\" in the right-hand side of the formula 
stands for the multiplication operator by WxW". Then, A^.,, is a symmetric operator on the 
Hilbert space L^(R^, '&k,a{x)dx) consisting of square integrable functions on against the 
measure ■&k,a{x)dx, where the density function d-k,a{x) on is given by 

&U^):=\\x\r^Y['^{a,x)t^. (1.2) 

The {k, a)-generalized Laguerre semigroup ^k,a{z) is defined to be the semigroup with 
infinitesimal generator ^A^. ^, that is, 

JkAz) ■■= exp(-A^,A (1.3) 

for z € C such that Re z > 0. (Later, we shall use the notation J'kA^ = ^kJc/z)^ in connection 
with the Gelfand-Gindikin program.) 

In the case a = 2 and ^ = 0, the density &k,a{^) reduces to j?o,2('^) = 1 and we recover the 
classical setting where 

Ao,2 = ^ — 2 ~ Hermite operator on L^(R^), 

^o,2(z) = the Hermite semigroup I(z) (HlQllBTII). 
In this paper, we shall deal with general a and k, and prove: 
Theorem A (see Corollary 13.221) . Suppose a and a multiplicity function k satisfy 

a>0, a + 2{k) +N -2>0. (1.4) 

1) A/t a extends to a self-adjoint operator on L^(R^, '&k,a(.x)dx). 

2) There is no continuous spectrum o/A/t ,,. 

3) All the discrete spectra are negative. 

We also find all the discrete spectra explicitly in Corollary '3.221 

Turning to the (k, a)-generalized Laguerre semigroup J^kAz) (see (|1.31) ). we shall prove: 
Theorem B (see Theorem 3.40) . Retain the assumption (11.41 ). 

1) =A,a(z) is a holomorphic semigroup in the complex right-half plane {z 6 C : Rez > 0} in 
the sense that ^k,a{z) is a Hilbert-Schmidt operator on L^(R^, '&kAx)dx) satisfying 

^kAZl) ° ^KaiZl) = ^k,a{Z\ + Z2), (RcZi, ReZ2 > 0), 

and that the scalar product iJ^k,a(z)f,g) is a holomorphic function of z for Rez > 0, for 
any f,geL\M!',&k,a{x)dx). 

2) =A,a(z) is a one-parameter group of unitary operators on the imaginary axis Rez = 0. 
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In Section 4.3 , we shall introduce a real analytic function ^{b, v; w; cos (f) in four variables 
defined on {{b, v, w, ^) 6 R+ x R x C x M^jlnZ : 1 + Z7v > 0}. The special values at = 1, 2 are 
given by 

J{\,v-w-t) = e^\ (1.5) 
^(2,v;w;0 = T{v (1.6) 

Here, I^iz) = (f )~'*/i(z) is the (normalized) modified Bessel function of the first kind (simply, 
/-Bessel function). 

We then define the following continuous function of t on the interval [-1,1] with parame- 
ters r, ^ > and z e {z e C I Re z > 0} \ inZ by 

_ ^_ exp(-^(r^ + ^")coth(z)) /2 2{k) + N-2 _ 2(r^)f 
sinh(z) ° " \^ 2 asmh(z) 

where (k) := j ^o-e.* ka is the index ofk = (ka) (see (2.3 )). 

For a function h{t) of one variable, let {Vi,h){x,y) be a ^-deformation of the function 
h{{x,y)) on R'^ x R.'^. (This A;-deformation is defined by using the Dunkl intertwining op- 
erator Vk, see (2.6)). 

In the polar coordinates x = ra> and y = sr], we set 

Ak^a(x,y;z) = Vk{hk,a(r, s;z; ■))(co,7]). 

For a > and a non-negative multiplicity function k, we introduce the following normal- 
ization constant 

The constant Ck,a can be expressed in terms of the gamma function owing to the work by 
Selberg, Macdonald, Heckman, Opdam [47 J, and others (see Etingov [fTSlI for a uniform 
proof). 

Here is an integration formula of the holomorphic semigroup J^tA^)- 

Theorem C (see Theorem 4.231) . Suppose a > and k is a non-negative multiplicity function. 
Suppose Rez > and z i «7rZ. Then, J^k,a(z) = exp(^A<:^) is given by 



:,«(Z) = Ck,a I 



f(y)Ak,a(.x,y;zWk,a(y)dy. (1.8) 



The formula (1.8) generalizes the k = case; see Kobayashi-Mano f39l for (k, a) = (0, 1), 
and the Mehler kernel formula in FoUand [20] or Howe [|31J for {k, a) = (0, 2). 

1 .2. (k, a)-generalized Fourier transforms JFk,a- 

As we mentioned in Theorem B 2), the 'boundary value' of the (k, a)-generalized Laguerre 
semigroup J^tA^) the imaginary axis gives a one-parameter family of unitary operators. 
The case z = gives the identity operator, namely, J^kA^) = id. The particularly interesting 
case is when z = y, and we set 

^k,a := c = cexp(^(||x|p-A, - |U||")) 
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by multiplying the phase factor c 



— -a — ) 



(see (\5.2ii ). Then, the unitary operator ^^-a 



for general a and k satisfies the following significant properties: 

Theorem D (see Propo sition 13.361 and Theorem[5]6]). Suppose a > and a + 2{k)+N-2 > 0. 
1) ^k,a is a unitary operator on L^(R^, '&i^ a{^)dx). 



2) ^u,a oE = -(E + N + 2{k) + a ■ 
Here, E = Ylj=\ xjdj. 

3) ^k,a O \\xr = -\\xf-"Ak O ^k,a, 



2) O 



^,,„o(iw|2-.A,) = -iixiro^,,, 



4) <^k,a is of finite order if and only if a e 

and q are positive integers that are prime to each other. 



Its order is 2pifa is of the form a = ^, where p 



We call ^i, a a {k, a)- generalized Fourier transform on R . We note that ^k,a reduces to 
the Euclidean Fourier transform ^ ifk = and a = 2; to the Hankel transform if ^ = and 
a = 1; to the Dunkl transform S^k introduced by C. Dunkl himself in [12J if > and a = 2. 

Thus, in these classical setting, our approach uses the following expressions of ^k,a'- 



e 4 exp —(A - ll^ll ) 



m(2(k)+N) m 

\ = e 4 exp — (A^ 



\x\?) 



(Fourier transform), 
(Dunkl transform). 



For a 



1 and k = 0, the unitary operator 

^0,1 =e^exp(-|W|(A- 1)) 



arises as the unitary inversion operator of the Schrodinger model of the minimal representa- 
tion of the conformal group 0(N+ 1 , 2) (see [|38ll39in . Its Dunkl analogue, namely, the unitary 
operator ^k,a for a = I and ^ > seems also interesting, however, it has never appeared in the 
literature, to the best of our knowledge. The integral representation of this unitary operator. 



^i^,(2(kHN~l)j^^j 



^q(2(k)+N-l) 



exp(y|W|(A,-l)), 



is given in terms of the Dunkl intertwining operator and the Bessel function because of the 
closed formula of yib, v; w; t) at b = 2 (see (1.6)). 

On the other hand, our methods can be applied to general k and a in finding some basic 
properties of the (fe, a)-generalized Fourier transform ^^. ^ such as the inversion formula, 
the Plancherel theorem, the Hecke identity (Corollary 5^0), the Bochner identity (Theorem 
i5.21i) , and the following Heisenberg inequality (Theorem 15. 28 1) : 



Theorem E (Heisenberg type inequality). Let 

L^(R^, §k,a{x)dx). Then, 



denote by the norm on the Hilbert space 



xpfix) , W^p^kji^) 



k Z 



for any f € L^(R^, d-k,a{x)dx). The equality holds if and only if f is a scalar multiple of 
e}L^{-c\\x\\") for some c > 0. 
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This inequality was previously proved by Rosier lISTI and Shimeno [54J for the a = 2 
case (i.e. the Dunkl transform ^i,). In physics terms we may think of the function where the 
equality holds in Theorem E as a ground state; indeed when a = c = I, N = 3, and = it is 
exactly the wave function for the Hydrogen atom with the lowest energy. 

1.3. 5l2-triple of differential-difference operators. 

Over the last several decades, various works have been published that develop applications 
of the representation theory of the special linear group SL{2, R). We mention particularly the 
books of Lang [43 J and Howe-Tan [|32|] . and the research papers of Vergne [59] and Howe 
QUI . These and other contributions show how the symmetries of 5I2 can offer new perspec- 
tives on familiar topics from inside and outside representation theory (character formulas, 
ergodic theory, Fourier analysis, the Laplace equation, etc.). 

The basic tool for the present article is also the S L2 theory. We construct an 5l2-triple of 
differential-difference operators with two parameters k and a, and then apply representation 
theory of S L{2, R), the universal covering group of S L{2, R). The resulting representation is 
a discretely decomposable unitary representation in the sense of [|36ll , which depends contin- 
uously on parameters a and k. 

To be more precise, we introduce the following differential-difference operators on R^ \ {0} 

by 



+ ^~ ._^u,M2-a, . 2^ ^ ^ N + 2{k) + a-2 

k,a 



-\\x\r, E,-, := -\\x\t"A,, R,,a := - V xtdt + 

a 'a a ^ 

i=i 

With these operators, we have 

aAk,a = i(El^,-E-^J. 

The main point here is that our operator Aj^ „ can be interpreted in the framework of the 
(infinite dimensional) representation of the Lie algebra 6l(2, R): 

Lemma F (see Theorem 3.2). The differential-difference operators {H/t„,E^^,E^^}/orm an 
sl2-triple for any multiplicity-function k and any non-zero complex number a. 

In other words, taking a basis of 5l(2, R) as 



0/' \1 0/' \0 -1 

we get a Lie algebra representation ojk,a of g = 6l(2, R) with continuous parameters k and a 
on functions on R^ by mapping 

h ^ H^,«, e+ ^ E^^^,, e" ^ E^^^. 

The main result of Section 3 is to prove that the representation co^^a of 5l(2, R) lifts to the 
universal covering group 5L(2, R): 

Theorem G (see Theorem 3.31). If a > and k is non-negative, then ojk^u lifts to a unitary 
representation ofSL(2,R) on L^(El^ ,'&i^ a{x)dx). 

Theorem G fits nicely into the framework of discretely decomposable unitary represen- 
tations BMl 123. In fact, we see in Theorem 3,32 that the Hilbert space L^(R^, '&f^a{x)dx) 
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decomposes discretely as a direct sum of unitary representations of the direct product group 
(£x5L(2rR): 



LHR\i^Ux)dx) . ^^^AR-) ^.(^!!i±M±i^), (1.9) 

m=0 



where J^'"(R'^) stands for the representation of the Coxeter group (£ on the eigenspace of the 
Dunkl Laplacian (the space of spherical ^-harmonics of degree m) and n{v) is an irreducible 
unitary lowest weight representation of 5L(2, R) of weight v + 1 (see Fact 3.27). The unitary 
isomorphism (1.9) is constructed explicitly by using Laguerre polynomials. 

For general N > 2, the right-hand side of (11.91) is an infinite sum. For N = I, (11.91) is 
reduced to the sum of two terms (m = 0, 1), and if = in addition, then (1.9) is essentially 
the same with Kostant's realization (42] of highest weight representations of SL(2,R). 

The unitary representation of S L{2, R) on L^(R^, §k,a{^)dx) extends furthermore to a holo- 
morphic semigroup of a complex three dimensional semigroup (see Section 3.8 ). Basic prop- 
erties of the holomorphic semigroup ^k,a{z) defined in (1.3) and the unitary operator ^k,a can 
be read from the 'dictionary' of 5l(2, R) as follows: 



l\ , r. \ < > -^k,a 

a 



-1 



exp iz qI < — > J^kAz) = expi^Ak^a) 
Wo = exp ^ „M < — > ^k,a (up to the phase factor) 



2 \1 

Ad(wo)e^ = e- ^ ^t,a o Wxf = -||x|p-"A,^,,, 



Ad(wo)e- = M ^k,a o \\x\t"Ak = -\\x\\"^k,a. 



1.4. Hidden symmetries for a = 1 and 2. 

As we have seen in Section 11. 11 one of the reasons that we find an explicit formula for the 
holomorphic semigroup J^kAz) (and for the unitary operator ^k.a) (see Section 1.1 ) is that 
there are large 'hidden symmetries' on the Hilbert space when a = 1 or 2. 

We recall that our analysis is based on the fact that the Hilbert space L^(R^, d-k,a{^)dx) has 
a symmetry of the direct product group d x 5L(2, R) for all k and a. It turns out that this 
symmetry becomes larger for special values of k and a. In this subsection, we discuss these 
hidden symmetries. 

First, in the case ^ = 0, the Dunkl-Laplacian A/, becomes the Euclidean Laplacian A, 
and consequently, not only the Coxeter group S but also the whole orthogonal group 0{N) 
commutes with Ajt = A. Therefore, the Hilbert space L^(R^, d-QA^)dx) is acted on by 0{N) x 
SL(2, R) (see Il45ll ). Namely, it has a larger symmetry 

£ X 5L(27R) c 0{N) X 5L(27R). 
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Next, we observe that the Lie algebra of the direct product group 0(N) x S L(2, R) may be 
seen as a subalgebra of two different reductive Lie algebras 5p(A^, R) and d(A'^ + 1,2): 

o(A^) © 5l(2, R) ^ o(N) © 0(1, 2) c o(A^ + 1, 2) 
o(A^) © 5l(2, R) ^ D(A^) © 5p(l, R) c 5p(A^, R) 

It turns out that they are the hidden symmetries of the Hilbert space L^(R^, '&oa(x)dx) for 
a = 1,2, respectively. To be more precise, the conformal group 0{N + 1, 2)o (or its double 
covering group if A^^ is even) acts on L^{R^ ,-&Q^i(x)dx) = L^(R^, ||x|r'(ix) as an irreducible 
unitary representation, while the metaplectic group Mp{N, R) (the double covering group of 
the symplectic group Sp{N, R)) acts on L^(R^, &Q 2(x)dx) = L^(R^, dx) as a unitary represen- 
tation. 

In summary, we are dealing with the symmetries of the Hilbert space L^(R^, §j^ai.^)dx) 
described below: 



0(A^+ 1,2) 

0{N)xSUX^) 



{k,a\ general) 




Mp{N, R) 



Diagram 1.4. Hidden symmetries in L^(R^, §k,a{x)dx) 

For a = 2, this unitary representation is nothing but the Weil representation, sometimes 
referred to as the Segal-Shale-Weil representation, the metaplectic representation, or the 
oscillator representation, and its realization on L^(R^) is called the Schrodinger model. 

For a = 1, the unitary representation of the conformal group on L^(R^, ||x||"^<ijc) is irre- 
ducible and has a similar nature to the Weil representation. The similarity is illustrated by 
the fact that both of these unitary representations are 'minimal representations', i.e., their an- 
nihilator of the infinitesimal representations are the Joseph ideal of the universal enveloping 
algebras, and in particular, they attain the minimum of their Gelfand-Kirillov dimensions. 

In this sense, our continuous parameter a > interpolates two minimal representations of 
different reductive groups by keeping smaller symmetries (i.e. the representations of 0{N) x 
SL{2, R)). The {k, a)-generalized Fourier transform a plays a special role in the global for- 
mula of the -model of minimal representations. In fact, the reductive groups are generated 
by a maximal parabolic subgroup and an inversion element. Since we can find a simple for- 
mula for the representation of a maximal parabolic subgroup, the global formula is obtained 
if we determine the action of an inversion formula. For the Weil representation, this action is 
the Fourier transform (up to the phase factor), and it is the Hankel transform for the minimal 
representation of the conformal group 0{N -1-1,2) (see [i38il . see also [40, Introduction] for 
some perspectives of this direction in a more general setting). 



(£x5L(2,R) 
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A part of the results here has been announced in [SJ without proof. 

Notation N = {0, 1, 2, . . . }, N+ = {1, 2, 3, . . . }, R+ = {jc e R U > 0}, and R>o = {t eR: 
t>0}. 

2. Preliminary results on Dunkl operators 

2.1. Dunkl operators. 

Let (•, •) be the standard Euclidean scalar product in K.'^. We shall use the same notation for 
its bilinear extension to x C^. For x 6 R^, denote by ||.jc|| = (x, x)^^^. 

For or 6 R^ \ {0}, we write for the reflection with respect to the hyperplane (a)-^ orthog- 
onal to a defined by 

ra{x) := X - 2 —a, x e R . 

\\a\r 

We say a finite set ^ in R^ \ {0} is a (reduced) root system if: 

(Rl) r,,(^) = ^ for aU ae^, 
(R2) ^ DRa = {±a} for aU ae^. 

In this paper, we do not impose cristallographic conditions on the roots, and do not require 
that ^ spans R^. However, we shall assume ^ is reduced, namely, (R2) is satisfied. 

The subgroup (£ c 0(N,R) generated by the reflections {r„ | a 6 ^} is called the finite 
Coxeter group associated with The Weyl groups such as the symmetric group for the 
type An_i root system and the hyperoctahedral group for the type Bf^ root system are typical 
examples. In addition, H^, H4 (icosahedral groups) and Ijin) (symmetry group of the regular 
n-gon) are also the Coxeter groups. We refer to [i27il for more details on the theory of Coxeter 
groups. 

Definition 2.1. A multiplicity function for (£ is a function k : M ^ C which is constant on 
d-orbits. 

Setting ka := k{a) for or 6 we have kha = ka for all /z e £ from definition. We say k is 
non-negative if ka > for all a £ The C-vector space of multiplicity functions on ^ is 
denoted by The dimension of is equal to the number of (£-orbits in M. 

For ^ e C'^ and k 6 Dunkl IITOl introduced a family of first order diff'erential-diff'erence 
operators T^(k) (Dunkl' s operators) by 



T^m(x) := d^f(x) + y ka{a,0^^^^^r^Y^, f 6 C^R"). (2.1) 



Here denotes the directional derivative corresponding to ^. Thanks to the (£-invariance of 
the multiplicity function, this definition is independent of the choice of the positive subsystem 
The operators T^{k) are homogeneous of degree -1. Moreover, the Dunkl operators 
satisfy the following properties (see IfTOll ): 

(Dl) L{h) o T^{k) o L{h)-^ = Th^{k) for aU he^, 
(D2) T^{k)T^{k) = T^{k)T^{k) for aU ^, 77 6 R^, 

(D3) T]{k){fg\ = gT^{k)f + fT^{k)g if / and g are in C\R^) and at least one of them is 
d-invariant. 
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Here, we denote by L{h) the left regular action of /z e d on the function space on R^: 

{L(h)f){x) := f(h-' ■ X). 

Remark 2.2. The Dunkl operators arise as the radial part of the Laplacian on the tangent 
space of a Riemannian symmetric spaces. Let Qbe a real semisimple Lie algebra with Cartan 
decomposition g = I © p. We take a maximal abelian subspace a in p, and let Z(g, a) be the 
set of restricted roots, and m^, the multiplicity of a & E(g, a). We may consider E(g, a) to 
be a subset of a by means of the Killing form of g. The Killing form endows p with a fiat 
Riemannian symmetric space structure, and we write Apfor the (Euclidean) Laplacian on p. 
Put ^ := 2Z(g, a) and ka := \ SySes+nRa f^p- ^ote that the root system M is not necessarily 
reduced. Then the radial part o/Ap, denoted by Rad{Ap), (see ll26l Proposition 3.13]j is given 
by 

Rad{\)f = A,/ 

for every ^-invariant function f e C'"(a), where is the Dunkl Laplacian which will be 
defined in (12.101). 

Let '&k be the weight function on defined by 

Mx):=Y]\{a,x)\^''-, xeR^. (2.2) 

It is d-invariant and homogeneous of degree 2{k), where the index (k) of the multiplicity 
function k is defined as 

{k):= Y,k, = ^Yjk,. (2.3) 

Let dx be the Lebesgue measure on R^ with respect to the inner product ( , ). Then the Dunkl 
operators are skew- symmetric with respect to the measure '&k(x)dx (see IITOll ). In particular, 
if / and g are differentiable and one of them has compact support, then 

r (T^(k)f)ix)g{x)Mx)dx = - f f(x)(T^(k)g)(x)Mx)dx. (2.4) 

It is shown in [fTTI that for any non-negative root multiplicity function k there is a unique 
linear isomorphism Vk (Dunkl' s intertwining operator) on the space ^(R^) of polynomial 
functions on R^ such that: 

(11) Vk(^,„(R^)) = ^„,(R^) for all m 6 N, 

(12) Vii^o(R'V) = id, 

(13) T^(k)Vk = Vkd^ for all ^ e R^. 

It is known that Vj, induces a homeomorphism of C(R^) and also that of C'^(R^) (cf. (5S]). 
See also [T7] for more results on Vk for C- valued multiplicity functions on 

For arbitrary finite reflection group d, and for any non-negative multiplicity function k. 
Rosier [|50l proved that there exists a unique positive Radon probability-measure jj.^ on R^ 
such that 

Vkfix)= f f{^)di/M). (2.5) 

Jr" 
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The measure yu^ depends on x 6 R'^ and its support is contained in the ball := 6 

I ll^ll < ||x||}. Moreover, for any Borel set S c R'^, ^ 6 £ and r > 0, the following invariant 
property holds: 

In view of the Laplace type representation (|2.5|) . Dunkl's intertwining operator Vk can be 
extended to a larger class of spaces. For example, let B denote the closed unit ball in R'^. 
Then the support property of /ij leads us to the following: 

Lemma 2.3. For any R > 0, Vk induces a continuous endomorphism of C(B(R)). 

Proof. Let / e C{B{R)). We extend / to be a continuous function / on R^. Then, Vkf is 
given by the integral 

vj(x)= f mdniia 

Suppose now x e B{R). Then Supp/iJ. c 5(||x||) c B(R). Hence, (Vkf)\BiR) is determined by 
the restriction / = Thus, the correspondence / i-^ iVtf)\B{R) is well-defined, and we 

get an induced linear map Vt'- C{B{R)) C{B{R)), by using the same letter. 

Next, suppose a sequence fj e C(B{R)) converges uniformly to / e C{B{R)) as j ^ oo. 
Then we can extend fj to a continuous function fj on R^ such that fj converges to / on every 
compact set on R'^. Hence V^fj converges to V^f, and so does Vkfj to Vkf. □ 

For a continuous function h{t) of one variable, we set 

hy(-) := h({;y)) (J6R^), 

and define 

(Vmx,y) := (Vthy)(x) = f h{{^,y))di/M)- (2.6) 

Then, {Vkh){x,y) is a continuous function on {x,y) 6 R'^ x R'^. 
We note that if = then _ 

{yoh){x,y) = h{{x,y)). 

If h{t) is defined only near the origin, we can still get a continuous function {Vkh){x,y) as 
far as Kx, j)| is sufliciently small. To be more precise, we prepare the following proposition 
for later purpose. For simplicity, we write B for the unit ball 5(1) in R^. 

Proposition 2.4. Suppose h(t) is a continuous function on the closed interval [-1,1]. Then, 
{Vkh){x,y) is a continuous function on Bx B. Further, V^h satisfies 

WMt-mB) < II/^IIl~([-u]) (2.7) 
(nh){x,y) = (VM(y,x). (2.8) 

Proof. We extend h to a continuous function h on R. It follows from Lemma 2.3 that the 
values (Vkh)(x,y) for {x,y) satisfying \{x,y)\ < 1 are determined by the restriction h = 
Hence, 

(Vkh)(x, y) : = (VjiXx, y), (x,y)eBxB 

is well-defined. 
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Since /ij is a probability measure, we get an upper estimate (i2.7i) from the integral expres- 
sion (2.6). 

By the Weierstrass theorem, we can find a sequence of polynomials hj{t) (j = 1,2, . . .) 
such that hj{t) converges to h{t) uniformly on any compact set of R.. Then, Vthj converges to 
Vkh uniformly onBx B. Thanks to [[III Proposition 3.2], we have {Vkhj)(x,y) = (Vkhj)(y, x). 
Taking the limit as j tends to infinity, we get the equation (|2.8|) . Hence, Proposition |2.4| is 
proved. □ 

Aside from the development of the general theory of the Dunkl transform, we note that 
explicit formulas for Vt have been known for only a few cases: (£ = Z^, CL = ^3, and the 
equal parameter case for the Weyl group of B2 (see [il5il for the recent survey by C. Dunkl). 

2.2. The Dunkl Laplacian. 

Let {^1, . . . , ^n) be an orthonormal basis of (R^, (•, •)). For the j-th basis vector ^j, we will use 
the abbreviation T^j(k) = Tj(k). The Dunkl-Laplace operator, or simply, the Dunkl Laplacian, 
is defined as 

N 

Ar.= YjTjikf- (2.9) 

7=1 

The definition of is independent of the choice of an orthonormal basis of R^. In fact, it is 
proved in [ 10] that A/, is expressed as 

Akfix) = Afix) + 2_.ka\ — -, : z \ , (2.10) 

where V denotes the usual gradient operator. 

For ^ = 0, the Dunkl-Laplace operator A^. reduces to the Euclidean Laplacian A, which 
commutes with the action of 0(N). For general k, it follows from (Dl) and (2.9) that A/, 
commutes with the action of the Coxeter group (£, i.e. 

L(h) o A^. o L(h)-^ = Ak, \fh e (£. (2.1 1) 

Definition 2.5. A k-harmonic polynomial of degree m{m eW) is a homogeneous polynomial 
p on R^ of degree m such that A^p = 0. 

Denote by ^'"(R^) the space of /^-harmonic polynomials of degree m. It is naturally a 
representation space of the Coxeter group (£. 

Let dcr be the standard measure on the density given in (|2.2i) . and dt the normal- 

izing constant defined by 

J, :=( r M(^)dcTico)y\ (2.12) 

We write L?-(S '^'^ , '&k(co)do-(co)) for the Hilbert space with the following inner product ( , )/, 
given by 

{f,g)k-=dk I fioj)g{a))'&k(oj)do-(a)). 
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For k = 0, d, is the volume of the unit sphere, namely, 



r(-) 

do = (2.13) 

2n2 



Thanks to Selberg, Mehta, Macdonald [|44l . Heckman, Opdam [|47ll . and others, there is a 
closed form of dt in terms of Gamma functions (see also IfTSlI ). 

As in the classical spherical harmonics (i.e. the k = case), we have (see [9, page 37]): 

Fact 2.6. 

1) J^i^'"(R^)\sN-i (m = 0, 1, 2, . . . ) are orthogonal to each other with respect to ( , )^. 

2) The Hubert space L^(S^~^,'&k(co)dcr(co)) decomposes as a direct Hilbert sum: 

L\s''-\Mco)dcT{co)) = ^,'"(R^)|5~-. . (2.14) 

meN 

We pin down some basic formulae of Ayt. We write the Euler operator as 

N 

E:=J]xjdj. (2.15) 

j=i 

Lemma 2.7. 1) The Dunkl Laplacian is of degree -2, namely, 

[£,A,] = -2A, (2.16) 

2) 

N 

2 (xjTjik) + Tjik)Xj) = N + 2{k) + 2E. (2. 17) 

7=1 

3) Suppose iff(r) is a C°° function of one variable. Then we have 

[A,, (A(lkir)] = a^lUlp-V'dl^ir) + a\\x\r^i/,'(MniiN + 2{k) + a - 2) + 2E). (2.18) 



Proof See [|25l Theorem 3.3] for 1) and 2). 

3) Take an arbitrary C" function / on R^. We recall from the definition (|2.1|) and (D3) that 

Tj{k)g = djg, (2.19) 
Tjmfg) = {Tj{k)f)g + f{djg), 

if ^ is a d-invariant function on R^. In particular, 

Tjikmw) = axj\\x\r^iif'(\\x\n, 

Tj{k)(pix)m")) = (Tj(k)f(x)m\x\n + axjf{x)\\x\r^ii,'(\\x\n 

Using (D3) again, we get 

Tj(kf(f(xmx\n) = (Tj(kff(x)m\x\n 

+ a\\x\r^if^'(\\x\n(xj{Tj{k)f(x)) + Tj(k)(xjf(x))) 

+ apix)xjTjm\Mr^^'(\\xr)). 
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Taking the summation over j, we arrive at 

Ak(f(xm\x\n) = (AkfixMiuin + aiuir-V(ii^ir)(2^ + + 2<^»/(x) 

+ af{x)E(\\x\r^iff'i\\x\n). 

Here, we have used the expression (|X9l) of A^, (|2717l) . and (12.191) . Now, (|2.18|) follows from 
the following observation: in the polar coordinate x = no, the Euler operator E amounts to 
r|:, and rj-^{f-'-il/'{f')) = (a - lY'-^i]/'{f') + ar^"-^ifj"{f'). □ 

To end this section, we consider a '(^, 6()-deformation' of the classical formula 

e"^"' o A o e-lWI' = A + A\\xf -IN- 4E. 
Lemma 2.8. For any v e C and a 0, we have 

e-M" o \\x\t"A^ o e-^jIWI" = Wx^-^Ak + v^\\x\r - v(iN + 2{k) + a-2) + 2E). (2.20) 

Proof. The proof parallels to that of Lemma 12.71 3). By the property (D3) of the Dunkl 
operators, we get 

Tj(k)(e'^^'^^"h{x)) = iTj(k)e'"'')h(x) + e^^yjik^x). 
Then, substituting the formula 

Tj(k)e'"" = dje'"" = Aaxj\\x\r^e'"\ 

we have 

g-^iwr o j^.(^) o = Aaxj\\x\r^h(x) + Tj(k)h(x). (2.21) 

Iterating (|2.211) and using 

Tjik)\\x\r^ = {a- 2)xj\\x\r\ 

we get 

^-AW o o ^A\w ^ (^XaXjWxW"-^ + Tj{k)f 

= A^a^x]\\xf"-^ + Aa\\x\r^{xjTj(k) + Tj{k)xj) 
+ Aa(a-2)xj\\x\r^ + Tjik)\ 

Summing them up over j, we have 

N 

e-'^"' oA,,o e-^IWI" = A^ + A^a^Wxf" + Aa\\x\r\a -2 + J^iXjTj(k) + Tj(k)xj)) (2.22) 

The substitution of (I2.17D and i = to (|2.22l shows Lemma. □ 

3. The infinitesimal representation co^^a of 5l(2, R) 
3.1. 5I2 triple of differential-difFerence operators. 

In this subsection, we construct a family of Lie algebras which are isomorphic to 5l(2, R) in 
the space of differential-difference operators on R'^. This family is parametrized by a non- 
zero complex number a and a multiplicity function k for the Coxeter group. 
We take a basis for the Lie algebra 5l(2, R) as 

H-^]- 
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The triple {e"^, e , h} satisfies the commutation relations 

[e+,e"] = h, [h,e+] = 2e+, [h,e-] = -26". (3.2) 

Definition 3.1. An 5I2 triple is a triple of non-zero elements in a Lie algebra satisfying the 
same relation with (3.2). 

We recall from Section T that A^^ is the Dunkl-Laplacian associated with a multiplicity 
function k on the root system, and that {k) is the index defined in (2.3). For a non-zero 
complex parameter a, we introduce the following diff"erential-diff"erence operators on R^: 

EL := -WAW E,-, := ^Iklp- A,, H,, := ^ ^ ^^^^ ^ ^ " ^ + - V xA- (3.3) 

a ' a a a ^ 

1=1 

The point of the definition is: 

Theorem 3.2. The operators E^, E^^ and M.),^aform an 5I2 triple for any complex number 
a and any multiplicity function k. 

Proof of Theorem \3.2i The operator E^ is homogeneous of degree a, and E^^ is of degree 
(2 - a) - 2 = -a by Lemma 2.7 1). Let E = xjdj be the Euler operator as in (2.15J. 
Since EI/. a is of the form j^E + constant, the identity [Hjt „, E^^J = ±2EL is now clear. 
To see [E^, E^^] = ]HIi-„, we apply Lemma 2.7 3) to the function i/^(r) = r. Then we get 

A/t o \\x\\" - M'Ak = aiN + 2{k) + a- 2)\\x\r^ + 2a\\x\r^E. (3.4) 

Composing the multiplication operator we have 

\\xf-"Ak o \\x\r - \\x\\-Ak = aiN + 2{k) + a-2) + 2aE. 

In view of the definition (3.3 ), this means [E^, E^^] = '¥Lk,a- 

Hence, Theorem 3.2, is proved. □ 

Remark 3.3. Theorem^! for particular cases was previously known. 

(1) Fora = 2andk = 0, {E^ ^,E^ ^,Wk^a} is the classical harmonic 5I2 triple {j\\x\\^ , -^A, ^ + 
2i Xidi]. This SI2 triple was used in the analysis of the Schrodinger model of the Weil 
representation of the metaplectic group Mp{N,R) (see Howe OTI . Howe-Tan [[32l|). 

(2) For a = 2 and k> Q, Theorem [3. 21 was proved in Heckman ||25l Theorem 3.3]. 

(3) For a = I and k = 0, {E^, E^^, H^^} is the 5I2 triple introduced in Kobayashi and 
Mano |[38l[39l where the authors studied the -model of the minimal representation 
of the double covering group ofSOo{N + 1,2). (To be more precise, the formulas in 
Il39]| are given for the 5I2 triple for {2EL, ^E^^j,Hj._„} in our notation.) 

(4) For k = 0, the interpolation parameter a was also introduced in Mano f45l. 

The differential-difference operators (13.31) stabilize C"'(R^ \ {0}), the space of (complex 
valued) smooth functions on \ {0}. Thus, for each non-zero complex number a and each 
multiplicity function k on the root system, we can define an R-linear map 



cot,a : 5l(2, R) ^ End(C"(R^ \ {0})) (3.5) 



by setting 



OJk,a(^) = Mk^a, OJk,a(^^) = E^, OJk,a(^ ) = E^_^. (3.6) 
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Then, Theorem 3.2 implies that oj^ a is a Lie algebra homomorphism. 

We denote by i7(5l(2, C)) the universal enveloping algebra of the complex Lie algebra 
5l(2, C) - 5l(2, R) Or C. Then, we can extend ( 3.5 ) to a C-algebra homomorphism (by the 
same letter) 

C0k,a : C/(5l(2,C)) ^ End(C"'(R^ \ {0})). 
We use the letter L to denote by the left regular representation of the Coxeter group d on 
C"(R^ \ {0}). 

Lemma 3.4. The two actions L of the Coxeter group d and a)k,a of the Lie algebra 5l(2, R) 
commute. 

Proof. Obviously, L{h) commutes with the multiplication operator E^^^ = As we saw 

in (2.11), L{h) commutes with the Dunkl Laplacian. Hence, it commutes also with E^^. 
Finally, the commutation relation [E^^,E^^] = Wk^a implies L{h) o Wk^a = ^k,a ° L(h). □ 

We consider the following unitary matrix 

-=4 (7 1Y (3.7) 



V2 

We set 



5u(l,l):={X6 5l(2,C):X*|i + ^,\X = 0}, 



[0 -\) \0 -Ij 

another real form of 5l(2, C). Then, Ad(c) induces a Lie algebra isomorphism (the Cayley 
transform) 

Ad(c) : 5l(2,R) ^ su(l, 1). 

We set 

Ad(c)/i =4^ "J) =j(e+-e-), (3.8a) 



n+:=Ad(c)e^ = i|j^ _| j = i(-h + je^ + jel, (3.8 b) 

n-:=Ad(c)e- = ^|jJ j = i(h + je" + ie"). (3.8 c) 

Correspondingly to (378 a - c), the Cayley transform of the operators (|3.6|) amounts to: 

Hyt,« := cok^ai^) = = — Ak^a, (3.9 a) 

a a 

, . 2E + iN + 2{k) + g - 2) - M^'^'At - 
Ka '■= ^k.ai'^ ) = ' 2^ ' (3-9 b) 

5- , .2E + (N + 2{k) + a-2) + \\x\t''Ak + M" 

E^^ := a)k,a(«- ) = -I • (3-9 c) 

Here, E = Y,f=i ^idi is the Euler operator. 

Since Ad(c) gives a Lie algebra isomorphism, {E^^^, E^^, H^-^} also forms an 5I2 triple of 
differential-difference operators. Putting v = +1 in Lemma 2.8, we get another expression of 
the triple {E^^^, E^ ^k,a} as follows: 
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Lemma 3.5. Let , Er , and Hj. „ be as in (l3.9l a. b, c). Then, we have: 



■'k.a' k,a' 

I 

2a 
i 



ll^ = a;,,„(n+) = -—e^ o Ult^A, o e'", (3.10 a) 

- coU^-) = -j^e-^ o \\x\t"A, o e^, (3.10 b) 

H,,, = ojU^) = e-- o Ih,,, - M o e- (3.10 c) 

= ^e-^ o ((A^ + 2{k) + a-2) + 2E- \\x\t"Ak) o e^. 
3.2. Differential-difference operators in tlie polar coordinate. 

In this subsection, we rewrite the difFerential-difFerence operators introduced in Section [3711 
by means of the polar coordinate. 
We set 

2m + 2{k)+N-2 

^k,a,m '■- • (3.11) 

a 

We begin with the following lemma. 

Lemma 3.6. Retain the notation o f Section \2.2\ For all if/ e C"'(l.+) and p e J^i^"(R.^), we 
have 

nk,a(p{xm\xr)) = [{Ak,a,,n + D-AdUII") + 2|U|| Vdl-^IDjpW, (3-12) 

Au[p{xmw)) = [a\Xk,a,m + i)iuir-V'(ikir) + a^\\xf"-^rmn}pix). (3.13) 

Proof. The first statement is straightforward because the Euler operator E is of the form r-^_ 
in the polar coordinates x = roj. To see the second statement, we apply (12.181) to p(x). Since 
Ep = mp and A^p = 0, we get the desired formula (|3.13D . □ 

We consider the following linear operator: 

n,a : C"(R^) ® C"(R+) ^ C~(R^ \ {0}), {p, ifj) ^ p(xm\x\n (3.14) 

Lemma 3.7. Via the linear map T^^a, the operators H/.^„ E^^, and E^^ (see 03)) take the 
following forms on ^"(R") ® C'"(R+).- 

r,,,o(id®(2r-^ + (i,,,,„ + l))) =H,,,or,,, (3.15 a) 



dr 

r,,,o(id®-r) =Ka°Tk,a (3.15 b) 



a 

/ d^ d \ _ 

Tk,a o (id ®ai[r— + {Ak,a,m + 1) j;:)) = ^k,a ° Tk,a (3.15 c) 

Proof. Clear from Lemma. 3. 6 and the definition (3.3) of M./. ^, E^^, and E^^. □ 

The point of Lemma [3771 is that the operators HI/t,a, E^^^, and E^^ act only on the radial part 
(J/ when applied to those functions p(x)tff{\\x\\") for p 6 .^""(R^). This fact will be used for 
the rest of this section and also in Section 4J. 
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For a > 0, we define an endomorphism of C'"(l.+) by 

Ua : C~(R^) ^ C^CR^), ^(0 ^ {Uagm := exp(-ir)g(^r). 

Clearly, Ua is invertible. Composing T^^a (see ((3J4j)), we define the following linear operator 

Sk,a by 

Sk,a ■= (Ua ® id) oTk,a. 

That is, Sk,a : ^"(R^) ® C^CR^) ^ C"(R^ \ {0}) is given by 

SkAP®8)(^)-=P(^)^M-hx\r)g(-\\x\\"). (3.16) 

We set 

£■ d 

Pt ■■= t-rj + (Ak,a,m + 1 - t)-. (3.17) 

dr dt 
Then Lemma 13771 can be formulated as follows: 





°Sk,a, 


= Ka 


° Sk.a, 


= Em 


O Sk,a- 



Lemma 3.8. Via the map S k,a, the operators lAk,a, E^,, and E^^^ take the following forms on 
J^'"(R^) ® C"(R+).- 

5^ o (ido(2?^ + (ii,«,„ + 1 - / 
^M o(id<S)^?) 

S,„o(id^2/', + ^-i,.,.-l 
Proof. Immediate from Lemma 3.7 and the following relations 

°d-r°''" = -a[dt-2 
U-'oroUa =^t. 

□ 

Similarly, by using (3.8 a-c), the actions of H/;^, E^, and E^^ (see (3.9 a-c)) are given as 
follows: 



Lemma 3.9. Let P, be as in (3.17 ). Then, through the linear map S k,a (see (3.16)), H^q, E^, 

andE-^ take the following forms on e^'"(R^) O C~(R+).- 

S u,a O (id ® - 2Pt + {Ak.a,,n + 1 )) = ^k,a O S k,a, 

Sk,a o (id0 - i(Pr - + ^ - - 0) = ° 

5 o (id ® - /(P, + t^)) = E-, o S . 
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3.3. Laguerre polynomials revisited. 

In this subsection, after a brief summary on the (classical) Laguerre polynomials we give a 
'non-standard' representation of them in terms of the one parameter group with infinitesimal 
generator tj^ + (A+ 1)^ (see Proposition |3.11D . 

For a complex number A e C such that Re A > - 1 , we write Lf '' for the Laguerre polyno- 
mial defined by 

L(-^)f^) •= ^-^ + ^^^ V _tf}^!i = V (-imA + i + i) . 

' ^! Z^(a+l),.j! Aj(f-j)]Y(A + j+l) • 

We list some standard properties of Laguerre polynomials that we shall use in this paper. 
Fact 3.10 (see ffl §6.5]). Suppose ReA> -1. 

1) Lf \t) is the unique polynomial of degree I satisfying the Laguerre differential equation 

(t^ + {A+\-t)j^ + £)f(t) = (3.18) 

and 

f'\0) = (3.19) 

2) ( recurrence relation ) 

(£ + t^-t + A+ l)Lf(t) = (€+ 1)41^, (0, (3.20 a) 

dt 

{i - t^)Lf{t) = {£ + A)Lf. it). (3.20 b) 

dt 

3) (orthogonality relation) 

' Lf\t)LWt)t'e"dt = ^^^ ^(^ + ^+1) . (3.21) 

{ \j s \j r(^+ 1) ^ ' 

4) {L''f\t) : £ 6 N}/orm an orthogonal basis in L^(R+, t'^e~'dt) if A is real and A> -I. 
Finally, we give a new representation of the Laguerre polynomial. 

Proposition 3.11. For any c and £ eM, 

exp(-c(r^ +iA+ Dj^y = i-cY€\Lf(-). (3.22) 
Since the differential operator 

d^ d 

is homogeneous of degree -1, namely, 5, = cB^ if x = ct, it is sufficient to prove Proposition 
[3?1 1 in the case c = 1. We shall give two different proofs for this. 

Proof 1. We set 

d d^ d 

It follows from [A, B] = -B that 

AB" = B"A - nB" 
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for all n e N by induction. Then, by the Taylor expansion = S^*- 

Ae'' = e~'A + Be'. 

Since At^ = 0, we get (5 - A){e~^t^) = 0, namely, e'^t'^ solves the Laguerre differential 
equation (|3.18D . On the other hand, e'^t^ is clearly a polynomial of t with top term t^. In view 
of d3J9b . we have e"^?^ = (-lY£ld^\t). □ 



Proof 2. A direct computation shows 



Therefore, 5^/ = for j > ^ and 



e 



_ y (-ly^'^nriA + £ + I) ^ 
- L (i-k)\r{A + k+i) ^ 

= i-iYe\Lf(t). 

Hence, Proposition i3. 1 li has been proved. □ 

3.4. Construction of an orthonormal basis in L^(R^, ■&kA^)d^)- 

We recall from (|L2I) and (|2.2I) that the weight function i}k.a on R'^ satisfies 

Therefore, in the polar coordinates x = rco {r > 0, oj e S^~^),^q have 

&k,aMdx = ?^^^*^*''-^'&k{i^)drda{co\ (3.23) 

where dcr{a)) is the standard measure on the unit sphere. Accordingly, we have a unitary 
isomorphism: 

L^iS^-^ M(^)dcr(a)))® L^(R+, r^^^^+^+^-^Jr) ^ L^CR^, i^m(x)Jx), (3.24) 

where (8) stands for the Hilbert completion of the tensor product space of two Hilbert spaces. 
Combining (3.24) with Fact 2.6, we get a direct sum decomposition of the Hilbert space: 

J^^(J^^'"(R^)\sN-i) (8) L\R+, r^^''^'-^^"-^dr) ^ L\R^, &k,a{x)dx). (3.25) 

meN 

In this subsection, we demonstrate the irreducible decomposition theorem of the 5I2 repre- 
sentation on (a dense subspace of) L^(R^, i^k,a{x)dx) by using (3.25) and finding an orthogonal 
basis for L\R^, r^<''^^^+"-^dr). 

For i,m eN and p e ^'"(R^), we introduce the following functions on R^: 

0("\p,-):=S,,,(p®4'*-"'^). (3.26) 
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Here, Su,a ■ C^'CR^) ® C~(R+) ^ C^i^^ \ {0}) is a linear operator defined in (STW), 4,«,„, = 
-(2m + 2(fc) +N -2) (see (3.1 1 )), and Lf\t) is the Laguerre polynomial. Hence, for x = ro) e 
R^(r >0, a;6 5^-'), we have 

a)f (p, X) = p{x)Lf''"-'\-\\x\f) exp(--llxir) (3.27) 

= piojy"L^;''""'\^r") exp(-^r"). 

We define the following vector space of functions on by 

WkM^) := C-span{0^"\p, ■) \ £ e M,m eM, p e ^'"(R^)}. (3.28) 

Proposition 3.12. Suppose k is a multiplicity function on the root system ^ and a > such 
that 

a + l{k) + - 2 > 0. (3.29) 

Let €, s, m,neN,pe ^'"(R^) and q e ^"(R^). 

1) ^f\p, x) 6 CiR^) n L2(R^, &ka{x)dx). 
2) 

r (a) ~u:) a'^''"'T{Akam + i+'^) C 

(^/{p,xW,\q,x)&k,aix)dx = 6,n,n5t,s — TTT^ — ttt; — 7" — p{oS)q{o))'&k{oj)da{aj) . 
3) WA,a(R^) is a dense subspace ofL^(R^, '&k,a{x)dx). 

Remark 3.13. The special values of our functions ^'^f^p, x) have been used in various set- 
tings including: 



a = 2 seeUSi §3], 

k = 0, N =1 see [Sa, 

k = 0, a = l see Ml §3.2]. 



Remark 3.14. The condition (i3.29D is automatically satisfied for a > and a non-negative 
multiplicity kifN>2. 

Proof. Our assumption (13.291) implies 

'ik,a,m > -1 for any m e N, 

and thus ^f \p, x) is continuous at x = 0. Therefore, it is a continuous function on x e R^ of 
exponential decay. On the other hand, we see from (3.23 ) that the measure {)-i, a{x)dx is locally 
integrable under the assumption (13.29) . Therefore, ^f\p, x) e L^(R'^, d-k,a{x)dx). Hence the 
first statement is proved. 

To see the second and third statements, we rewrite the left-hand side of the integral as 

( r Lf-'-\-r")Lf-''\-r")tM--r"y''-'^^^^^^ f p{co)^)Mio)dcriio)) 

^Jo a a ^ a ' '^Js^-^ ' 

in the polar coordinates x = roj. Since fc-harmonic polynomials of difi'erent degrees are 
orthogonal to each other (see Fact 2.6), the integration over 5^"' vanishes \im + n. 
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Suppose that m = n. By changing the variable t := ^r", we see that the first integration 
amounts to 

— - — 4 "XO^ (3.30) 
By the orthogonality relation (1 3.211) . we get 



(13301) = 5 



ts- 



2^+^k,u„Y{i+ 1) 



Hence, the second statement is proved. The third statement follows from the completeness 
of the Laguerre polynomials (see Fact 3.10 4)). □ 

We pin down the following proposition which is already implicit in the proof of Proposition 
[3l2f 

Proposition 3.15. We fix m e N, a > 0, and a multiplicity function k satisfying 

2m + 2{k) + N + a-2>0. 

We set 

_ 2-'^-°-^'r(^ + 1) y /2^,^(,,,„)/ 2. j. ^^^ ^ (3 3^^ 

■'On^ ^ V^i.,,„„r(4,^^ + ^+ 1)^ ^ ' ^a ^ ^ ^ 

Then {fi"lir) : £ e M] forms an orthonormal basis in L^iR+,r^^''^^^^"-^dr). 

Remark 3.16. Let Cq,C\, . . . be a sequence of positive real numbers. Fix a parameter a > 
0. Dunkl [14J proves that the only possible orthogonal sets {Lf \c(r) exp(-^C{r)}'^^Q for the 
measure r"*^dr on R+, with p > 0, are the two cases (1 ) p = 0, c^ = c^for all €; (2) p = 1, 

For each m 6 N, we take an orthonormal basis {h''j"''}jej„, of the space <^'"(R^)|5<v-i . Propo- 
sition [3712] immediately yields the following statement. 

Corollary 3.17. Suppose a > and k satisfy the inequality (.3.29) . For ^, m 6 N and j € Jm, 

we set 

Then, the set {o^"], j \ £ e N,m e N, j e J, }^ forms an orthonormal basis ofl}{R^, '&k,a{^)dx). 
Remark 3.18. A basis ofJ^f^"\R^) is constructed in 1161 Corollary 5.1.13]. 
3.5. 5I2 representation on L^(R'^, '&kaix)dx). 

Now we are ready to exhibit the action of the 5I2 triple {k, n+, n } on the basis ^f \p, •) (see 
(i3.27j for definition). We recall from (3.9 a-c) that H^. ^ = a»i;a(k), E^^ = (^^^(n^), and 
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Theorem 3.19. Let Wk^a^"^) be the dense subspace of L^iR^ ,§k,ai^)dx) defined in (3728). 
Then, Wit_a(R^) is stable under the action of 6l(2, C). More precisely, for each fixed p 6 
^'"(R^X the action iOk,a (see (3.9 a-c)j is given as follows: 

coUm'fiP, ^) = (2^ + ^k,a,m + m["\p, X), (3.32 a) 

ojU^-')(^f\p^ X) = i(i + xX (3.32 b) 

OJkAn)^f\p, X) = K€ + h,a,mWt\{p, X\ (3.32 C) 

where ^fXp, x) is defined in (137271) and Ak^a,m = (2m + 2{k) + N - 2)/a (see (|3.111) ). We have 
used the convention O^^'j = 0. 

Theorem B. 19l may be visualized by the diagram below. We see that for each fixed k, a, and 
p 6 ^"(R^), the operators ojk^ai^'^) and ojk,a(i^~') act as shift operators. 




Diagram 3.5. 

Here, the dots represent CL)k,a(^) eigenvectors ^f\p,x) arranged by increasing 0Jk,a(^) 
eigenvalues, from left to right. 

Proof of Theorem 3.19 . For simplicity, we use the notation = t^ + {Au^a,m + 1 - 0^ as in 
(|3.17b . and set A = Ak,a,m- By the formula O^^^p, •) = S k,a{p®L^f) (see (3.26)) and by Lemma 
I3.9[ it is sufficient to prove 

{-IPt + {A+ \))Lf = {2£ + A+ l)Lf, (3.33 a) 

{-i{P, -tj^ + t-A- l))Lf = i{€ + l)4f J , (3.33 b) 

- i{Pt + tj^Lf = i(£ + A)Lf\ . (3.33 c) 

Since the Laguerre polynomial Lf\t) satisfies the Laguerre differential equation 

p,Lf(t) = -afit) 

(see (IS-ISI) ). the assertion (|3.33 a ) is now clear. The assertions (|3.33 bl) and (|3.33 cl) are 
reduced to the recurrence relations (3.20 a) and (3.20 b), respectively. □ 

Remark 3.20. An alternative proof of (|3.32 a|) will be given in Section \5.4\ (see Remark VS.lT^ . 

By using the orthonormal basis [ffliir)} (see (I3.31|) '). we normalize O^^^jc, x) as 

^{p,x):=f^p{co) (3.34) 

2-'^'---"^'r(^+l) ^k^(a), . 

= (a^..™r(i,.,. + ^+l)) ^^^^'^^ 
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for X = ro) {r > 0, 0) e 5^"'). Then, Theorem |3.19| is reformulated as follows: 

Theorem 3.21. For any p e ^.'"(R^), we have 

0JUmf\p, X) = (2£ + Ak,a,m + mf\p, X), (3.35 a) 

coUri^)^"\p, X) = i ^J{i+\){Xk,a,m + €+mtM, x\ (3.35 b) 

ajUT^-)^f{p, X) = i^iAk,a,m + £)i^fiip, X). (3.35 c) 

We recall that an operator T densely defined on a Hilbert space is called essentially self- 
adjoint, if it is symmetric and its closure is a self-adjoint operator. 

Corollary 3.22. Let a> and kbe a multiplicity function satisfying (3.29). 

1) The differential-difference operator Ai^a = - is an essentially self-adjoint 
operator on L^(R^, ^i^ a^dx). 

2) There is no continuous spectrum o/A^ q. 

3) The set of discrete spectra of -A/, a is given by 

[lai + 2m + 2{k) + N -2 + a : i,m el^} (N>2), 
{2ai + 2{k) +a+l : f e N} (A^ = 1). 

Proof. In light of the formula ( 3.9^ 

Ak,a = -aCOk,a(^)^ 

the eigenvalues of A^^ ^ are read from Theorem |3.191 Since Wk^ai^'^) is dense in L^(R^, ■&^ aix)dx) 
(see Proposition |3.12|) , the remaining statement of Corollary 13. 22| is straightforward from the 
following fact. □ 

Fact 3.23. Let T be a symmetric operator on a Hilbert space Jif with domain D(r), and let 
{fn]n be a complete orthogonal set in . If each f„ e D(r) and there exists p„ eE. such that 
Tfn = Mnfn,for cvcry n, then T is essentially self-adjoint. 

Remark 3.24. We shall see in Theorem 'i. 37 ' that the action of 5l(2, R) in Theorem '3. 21} lifts 
to a unitary representation of the universal covering group S L{2, R) and that Corollary \3.22\ 
1) is a special case of the general theory of discretely decomposable (qq, K)-modules (see 

mm). 

3 .6. Discretely decomposable representations. 

Theorem 3.19 asserts that Wk,a{^^) is an 5l(2, C)-invariant, dense subspace in L^(R^, d-k,a{x)dx). 
For A'^ > 1, this is a 'huge' representation in the sense that it contains an infinitely many in- 
equivalent irreducible representations of 5l(2, C). 

By a theorem of Harish-Chandra, Lepowsky and Rader, any irreducible, infinitesimally 
unitary (gc, ^)-module is the underlying (gc, ^) -module of a (unique) irreducible unitary 
representation of G (see [35 , Theorem 0.6]). This result is generalized to a discretely decom- 
posable (gc, ^)-modules by the second-named author (see [37 1 Theorem 2.7]). 

In this section, we discuss the meaning of Theorem 13.191 from the theory of discretely 
decomposable representations. 

We begin with a general setting. Let G be a semisimple Lie group, and K a maximal 
compact subgroup of G (modulo the center of G). We write g for the Lie algebra of G, and 
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Qc for its complexification. The following notion singles out an algebraic property of unitary 
representations that split into irreducible representations without continuous spectra. 

Definition 3.25. Let ('ut,X) be a (gc, K)-module. 

(1) ((361 Part !,§!]) We say m is K-admissible if dim Homs:(r, m) < oo for any t 
(I) ( [|36l Part III, Definition 1.1]) We say w is a discretely decomposable if there exist a 
sequence of (gc, K)-modules Xj such that 



Xj/Xj.i is of finite length as a (gc, K)-module for j = 1,2,... . 

(3) We say w is infinite simally unitarizable if there exists a Hermitian inner product ( , ) on 
X such that 

(TiT(Y)u, v) = -{u, vt(Y)v) for any Y e q, and any u,v e X. 
We collect some basic results on discretely decomposable (gc, ^)-modules: 

Fact 3.26 (see |l36l|371|). Let {tu,X) be a (gc, K)-module. 

1) VT is K-admissible, then xu is discretely decomposable as a (gc, K)-modules. 

2) Suppose VT is discretely decomposable as a (Qc,K)-module. Ifvj is infinitesimally unita- 
rizable, then VT is isomorphic to an algebraic direct sum of irreducible (gc, K)-modules. 

3) Any discretely decomposable, infinitesimally unitary {q,c, K)-module is the underlying 
{Qc, K)-module of a unitary representation ofG. Furthermore, such a unitary representa- 
tion is unique. 

We shall apply this concept to the specific situation where g = 5l(2, R.) and G is the univer- 
sal covering group 5L(2, R) of 5L(2, R.). 
We recall from (3.8 a) that 



Let t : = R(e - e"^) = z Rk and K be the subgroup of G with Lie algebra f . Since G is taken to 
be simply connected, the exponential map 



oo 





R ^ iS:, t^ Exp(zYk) 



is a diffeomorphism. 
For z 6 / R, we set 




(3.36) 



Since {k, n"^, n } forms an 5I2 triple, we have 

Ad(y,)n+ = e'^^n^. 



Ad(yjn = e^^n 



Then it is easy to see that the subgroup 

C(G) := {y, 



nm 



n e Z} ^ Z 



(3.37) 



coincides with the center of G. 
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Next, we give a parametrization of one-dimensional representations of ^ - R as 

K^C, x.^ti (3.38) 

by the formula ;t'^,(y,) = e''^'- or equivalently, dx^(^) = jJ- 
We shall call;^'^ simply as the ^-type yu. 

Let (tit, X) be a (gc,^)-module. A non-zero vector v 6 X is a lowest weight vector of 
weight jjL eCiiv satisfies 

'Uj{n~)v = 0, and cT(k)v = fiv. 

We say (m, V) is a lowest weight module of weight // if V is generated by such v. For each 
/I 6 C, there exists uniquely an irreducible lowest weight (Qc, ^)-module, to be denoted by 
nK{X), of weight A+l. 

With this normalization, we pin down the following well-known properties of the (qc, K)- 
module for g = 5l(2, R): 

Fact 3.27. 

1) For a real A with A> -I, there exists uniquely a unitary representation, denoted by n{A), 
ofG = S L{2, R) such that its underlying (gc, K)-module is isomorphic to nK{A). 

2) 7r(-l) is the trivial one-dimensional representation. 

3) For A> Q, tx{A) is a relative discrete series representation, namely, its matrix coefficients 
are square integrable over G modulo its center C{G). 

4) n{\) © 7r(-^) is the Weil representation of Mp(l,R), the two fold covering group of 
5L(2,R). 

5) (see (3.36)j acts on n{A) as scalar g-'^'W+i) if^ = jii 

6) n(A) is well-defined as a unitary representation of Mp{\,W) if A 6 ^Z, ofSL{2, R) if A 6 Z, 
and ofPSL(2, R) if A 6 2Z + 1. 

7) For A ^ -1, -3, -5, . . . ,nK(.A) is an infinite dimensional representation. For A > -1, we 
can find an orthonormal basis {vc : £ e N} such that 

TTKiAmv, ={2£ + A+\)v,, 

M^)(n+)v, = /V(^TT)(IT7TT)v,+i, 

nK(A)in-)ve = i yjiA + e)ev[-i. 

Here, we set v_i = {0}. In particular, tik^A) has the K-type [A+ \, A + 3, A + 5, . . .]. 

8) For A = —m (m = 1,2,...), nxiX) is an m-dimensional irreducible representation of 
5l(2, C). 

By using Fact l3.27i, we can read from the formulas in Theorem 13.211 the following state- 
ment: 

Theorem 3.28. Suppose a is a non-zero complex number and k is a root multiplicity function 
satisfying the inequality (I3.29ii ). i.e. a -I- 2{k) -\- N - 2 > 0. 

1) {a>k,a, Wk,a(^^)) is a^x (qq, K)-module. 

2) As a (qc, K)-module, cok,a is K-admissible and discretely decomposable (see Definition 
dJ5J. 
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3) {oJk,a, Wk^ai^^)) is decomposed into the direct sum of^x (qc, K)-modules as follows: 

oo 

W,,«(R^) - ^;"(R^) ® nK{h,a,,n). (3.39) 

m=0 

Here, A,^a,n = 2l2±M±^ 

Remark 3.29. The assumption (I3.29D in Theorem \3.28\ allows the multiplicity function k to 
be negative. 

Proof of Theorem '3.28. We fix a non-zero p e ^'"(R^). Then, it follows from Theorem |3.19l 
and Fact 3.27 that for 5l(2, R) acts on the vector space 

C-span{(!)f\p, ■) : ^ 6 N} 

as an irreducible lowest weight module nK{ylk,a,m)- By (3.25), we get the isomorphism (3.39) 
as (qc, ^)-modules. 

On the other hand, the Coxeter group d leaves ^'"(R'^) invariant. Furthermore, as we saw 
in Lemma 3.4, the action of (£ and 5l(2, R) commute with each other. Hence, the first and 
third statements are proved. 

It follows from the decomposition formula (13.391) that cot^a is ^-admissible because the 
^-type of an individual nKiA) is of the form {A + l,A + 3, . . .} hy Fact 3.27, Ak,a,m increases 
as m increases, and dim J^^"\E.^) < oo. Hence, the second statement is also proved. □ 

For f,g e L^iR^, ^k,a{^)dx), we write its inner product as 



{(f,8h-= J^Jix)g(x)&Ux)dx. (3.40) 

Proposition 3.30. Suppose a > and a + 2{k) + N - 2 > 0. Then, the representation oji^ a of 
5l(2, R) on VK/t a(R^) is infinite simally unitary with respect to the inner product (( , namely, 

{{coUX)f,g))k = -{{f,0JUX)g))k 
for any X e 5l(2, R) and f,ge Wk,a(^^). 

Proof. As we saw in (124D that the Dunkl operators are skew- symmetric with respect to the 
measure '&k(x)dx. In view of the definitions of A/, (see ( 2.9D ) and E^^ = ^||;c||^""A/t (see 
(^3.3)), we see that ^ is a skew-symmetric operator with respect to the inner product ((•, •))^. 
Likewise for E^ . Further, the commutation relation Hi. „ = [E^ , E7 1 shows that Ht „ is also 
skew- symmetric. Thus, for all X £ 5l(2, R), cok^aiX) is skew-symmetric. □ 

3 .7. The integrability of the representation cok,a- 

Applying the general result on discretely decomposable representations (see Fact'3.26) to our 
specific setting where G is the universal covering group of SL{2, R), we get the following two 
theorems: 

Theorem 3.31. Suppose a > and k is a multiplicity function satisfying 

a + 2{k) + N-2>0. (3.41) 
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Then the infinitesimal representation coi^a o/5l(2,K.) lifts to a unique unitary representation, 
to be denoted by Qk,a, ofG on the Hilbert space L^(R^, {)-i, a(x)dx). In particular, we have 



at 



nU^xpitX)), X e g, 

t=0 



on Wit_a(R^), the dense subspace (3.28) of L^(R^ ,'&i,^a(x)dx). Here, we have written Exp for 
the exponential map of the Lie algebra 5l(2, R) into G. 

Theorem 3.32. Retain the assumption of Theorem \3.31\ Then, as a representation of the di- 
rect product group d X G, the unitary representation L^(R^, i}k a{x)dx) decomposes discretely 
as 

CO 

l2(R^, &U^)dx) = _^''(^,'"(R^)|5~-.) niAk.a,J. (3.42) 

m=0 

Here, we recall that d is the Coxeter group of the root system, G is the universal cover- 
ing group ofSL{2,R), and Ak,a,m = ^'"+2<^>+^-^ (see (BUT)). The decomposition (3A2}i of 
the Hilbert space L^(R^, ■&i^ a(x)dx) is given by the formula (I3.25|) and n(A) (A > -1) is the 
irreducible unitary representation ofSL(2, R) described in Fact \3.27\ In particular, the sum- 
mands are mutually orthogonal with respect to the inner product (3.40) on L^(R^, d-k,a{x)dx). 

Remark 3.33. In f425 Kostant exhibits a family of representations with continuous parameter 
o/5l(2, R) by second order differential operators on C°°{R+). By a change of variables, his 
case corresponds tok = and N = \. He uses Nelson 's result [|46ll to study the exponentiation 
of such representation. In this case, the sum (|3.42b is reduced to a finite sum ( indeed, there 
are two summands) because .^""(R^) = ifm > 2 and N = 1. See also ||49l . 

Remark 3.34. The assumption a + 2{k) + N - 2 > implies 

^k,a,m > -1 for any m 6 N, 

whence there exists an irreducible, infinite dimensional unitary representation n(Ak^a,m) ofG 
such that its underlying (qq, K)-module is isomorphic to T^K^^hajn) by Fact 3.27 (1). 

By the explicit construction of the direct summand in Theorem i3.19i we have 

Corollary 3.35. As a representation of S L(2, R), minimal K-types of the irreducible sum- 
mands in (3.42) are given by 

h(x) exp(-i|Uir), h e ^'"(R^). 

As we have seen that ojk^a lifts to the unitary representation « of the universal covering 
group G = S L{2, R) for any k and a with certain positivity (I3.4T1) . On the other hand, if k and 
a satisfies a certain rational condition (see below), then Q./. ^ is well-defined for some finite 
covering groups of PSL{2,W). This representation theoretic observation gives an explicit 
formula of the order of the (k, a)-generalized Fourier transform ^^. ^ (see Section 5 ). We pin 
down a precise statement here. 

Proposition 3.36. Retain the notation of Theorem \3.31\ and recall the definition of the index 
(k) from (|2.3l) . Then the unitary representation Qf, a of the universal covering group G of 
S L(2, R) is well-defined also as a representation of some finite covering group of PSL{2, R) 
if and only if both a and (k) are rational numbers. 
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Proof. It follows from Fact 3.27J5) that the central element y„„i 6 C(G) acts on n(Ai,a,m) by 
the scalar 

nMA, +n / " ^ \ / N + 2(k) + a-2 \ 
^ a ' ^ a ' 

This equals 1 for all m if and only if 

n n{l{k) + N -2 + a) 

- 6 Z and 6 2Z. 

a a 

It is easy to see that there exists a non-zero integer n satisfying these two conditions if and 
only if both a and (k) are rational numbers. For such n, Q.j, a is well-defined for G/nZ. Hence, 
Proposition 3.36 is proved. □ 

We recall from (331) that we have identified the center C(G) of the simply-connected Lie 
group G = S L(2, R) with the integer group Z. Then, we have 

PSL(2,W) ^ G/Z, 5L(2,R) ^ G/2Z, Mp(l, R) ^ G/4Z. 

As a special case of Proposition 3.36 and its proof, we have: 

Remark 3.37. Let Qic,a be the unitary representation of the universal covering group G. 

(1) Suppose a = 2. 

(a) Qj^ 2 descends to S L{2, R) if and only if2{k) + N is an even integer 

(b) Q.k2 descends to Mp{\,W) if and only if2{k) + N is an integer. 

This compares well with the Schrddinger model on L^(R^) of the Weil representa- 
tion Qq 2 of the metaplectic group Mp{N, R) and its restriction to a subgroup locally 
isomorphic to SL(2, R) (cf. 11611 and [|32l ). 

(2) Suppose a = \. 

(a) descends to PS L{2, R) if and only if2{k) + N is an odd integer. 

(b) 1 descends to SL{2, R) if and only if2{k) is an integer 

(c) descends to Mp{\,W) if and only ifA{k) is an integer 

The case k = corresponds to the Schrddinger model on L^(R^ , j^) of the minimal 
representation Qo,i of the conformal group and its restriction to a subgroup locally 
isomorphic to S L(2, R) (cf. fl4Hl ]. 

Remark 3.38. C. Dunkl reminded us of that the parity condition of2{k) + N appeared also 
in a different context, i.e., in (TV, Lemma 5.1], where the authors investigated a sufficient 
condition on k for the existence and uniqueness of expanding a homogenous polynomial in 
terms of k-harmonics. 

3.8. Connection with the Gelfand-Gindikin program. 

We consider the following closed cone in g = 5l(2, R) defined by 

W:=ir ^ \:a' + bc<0, b>c 



\c -a 

Then, W is S L{2, R)-invariant and is expressed as 

W = /Ad(5L(2,R))R>ok. 
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We write exp^ : gc SL{2, C) for the exponential map. Its restriction to iW is an injective 
map, and we define the following subset Y{W) of 5L(2, C) by 

Y{W) :=5L(2,]R)expcOW). 

Since W is 5L(2, R.)-invariants, T{W) becomes a semigroup, sometimes referred to as the 
Olshanski semigroup. 

Denote by Y{W) the universal covering semigroup of r(VF), and write 

Exp : (3 + iW f(W) 

for the lifting of expc |g+,w : 9 + ^ Y{W). Then YiW) = SL(2rR)Exp(iW) and the polar 
map 

5L(27R) xW ^ Y{W), {g,X) ^ ^ExpOT) 

is a homeomorphism. 

Since W is an Ad(5L(2, R))-invariant cone, T{W) is invariant under the action of 5L(2, R) 
from the left and right. Thus, the semigroup T{W) is written also as 

Y{W) = 5L(2,R)expc(-R>ok)5L(2,R). 

Its interior is given by 

Y(W°) = 5L(2,R)exp(-R+k)SL(2,R). 

See [|28l Theorem 7.25]. Accordingly, we have 

fW) = 5L(27R)expc(-R>ok)5L(27R). 

By Theorem 13. 191 Qj. ^, is a discretely decomposable unitary representation of S L(2, R) on 
L2(R^, '&ka(x)dx). It has a lowest weight i2{k) + N + a - 1)1 a. It then follows from |l29l 
Theorem B] that Q.k^a extends to a representation of the Olshanski semigroup Y{W), denoted 
by the same symbol Q.k^a, such that: 

(PI) Q-k^a '■ Y(W) SS{L^) is strongly continuous semigroup homomorphism. 

(P2) For all / e L2(R^, §k^a{x)dx), the map y ^ «f2^,«(r)/, f))k is holomorphic on Y^). 

(P3) aUyr = ^Uyh, where r« = Ex^{iX)g~' for y = ^Exp(/X). 

Here, we have denoted by the space of bounded operators on L^(R!^ , §k,a{x)dx). 

Remark 3.39. The Gelfand-Gindikin program ||23]| seeks for the understanding of a family 
of irreducible representations ' by using complex geometric methods. This program has been 
particularly developed for lowest weight representations by Olshanski [48] and Stanton ||55l . 
Hilgert, Neeb [28 1, and some others. The study of our holomorphic semigroup Q-k^a by using 
the Olshanski semigroup Y{W) may be regarded as a descendant of this program. 

Henceforth we will use the notation C+ := {z 6 C | Re(z) > 0} and C++ := {z e C | Re(z) > 

0}. 

For z 6 C+, we extend the one-parameter subgroup y^, (z e R) (see (13.361) ) holomorphically 

as 

7, := Exp(-zk) = Exp(/z {\ % e Y(W)- (3.43) 
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Then, the operators ^k,a(7z) have the following property: 
^kATzT = ^(7z\ z e C^ 

^kAro) = id . 

Following the formulation of [39, Proposition 3.6.1] (the case k = 0, a = I), we summarize 
basic properties of the holomorphic representation Qj. „ of the semigroup T{W). 

Theorem 3.40. Suppose a > and k is a multiplicity function on the root system satisfying 
(13:29]) . i.e. a + 2{k) +N-2>0. 

(1) The map 

fW) X l2(r^, &u^)dx) l2(r^, &Mdx), (r, /) ^ iikA7)f 

is continuous. 

(2) For any p e ^^"^(R^) and £ e M, ^f\p, •) (see (IXTT]) ) is an eigenfunction of the 
operator Q.kA7z) = oxp{a>kA-z^))- 

nkA7z)'^f\p,x) = e-'^''''--^'^^'W;\p,x), 

where Ak,a,m = \{2m + 2{k) +N -2) (see (l3JT )). 

(3) The operator norm ||f2yt,a(yz)llop is exp(-^(2(fc) + N + a - 2)Rez). 

(4) If Re(z) > 0, then QkATz) is a Hilbert-Schmidt operator 

(5) If Re(z) = 0, then QkA7z) is a unitary operator 

Proof. The second statement follows from (3.32 a). The fifth statement is a special case of 
Theorem 3.31 , The proof of other statements is parallel to that of (391 Proposition 3.6.1], and 
we omit it. □ 

4. The integral representation of the holomorphic semigroup Q.kA7z) 

We have seen in Theorem |3.40l that ^kA7z) ^ Hilbert-Schmidt operator for Re z > and 
is a unitary operator for Re z = 0. By the Schwartz kernel theorem, the operator Q.kA7z) can 
be expressed by means of a distribution kernel AkA^^y\z). If we adopt Gelfand's notation 
on a generalized functions, we may write the operator 0.kA7z) on L^(R^, §kA^)dx) as an 
'integral transform' against the measure &kA^)dx: 

0.kA7z)f(x) = Ck,a I AkAx^r^z)f(y)&k,a(y)dy. (4.1) 
The normalization constant Ck,a vvill be defined in (4.471). In light of the unitary isomorphism 

L'(R'','&kA^)dx) ^ L'iR'',dx), fix) ^ f{x)&kA.x)^- 

We see that J^kAx^y'^z)'0-kAx)^'^k,a(y)^^ is a tempered distribution of {_x,y) 6 x R^. 

The goal of this section is to find the kernel KkA^^y^z). The main result of this section is 
Theorem 4.23, 
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4. 1 . Integral representation for the radial part of QtAyz)- 

By Lemma 3.7, the 5l2-action cok,,, on C°°(R'^ \ {0}) (see (3.5) for definition) can be described 
in a simple form on each ^-spherical component ^""(R.^), namely, it can be expressed as 
the action only on the radial direction. Accordingly, we can define the 'radial part' of the 
holomorphic semigroup Q^.'^^y^) (see (i4.4|) below for definition) on L^(K.+, r^'-''^'^^'^"~^dr). The 
main result of this subsection is the integral formula for Q.^^^(y^), which will be given in 
Theorems 4.4i and 4.5( 

4.1.1. Radial part of holomorphic semigroup. 

Recall that ^'"(K.'^) is the space of fc-harmonic polynomials of degree meN. Let 

: ^^\M!')\sN-,®L\^^,r^''^^*''*''-^dr) L^M!" ,§U^)dx) 
be a linear map defined by 

® /)W = for P e and / e L\M.,, r^^'^^'^^^-'dr). 

\\m\ 

Summing up cr^^^ we get a direct sum decomposition of the Hilbert space: 

l2(R^, ^kAx)dx) = ^'"(R^)|5iv-, ® l2(R+, r^^''^'-''^"-^dr). (4.2) 

meN 

It follows from Theorem 13.321 that the unitary representation of 5L(2, R) on the Hilbert 
space L^(R^, ■&k^a{x)dx) induces a family of unitary representations, to be denoted by fl^^^y,) 
(m e N), on L2(R+, r2<*^>+^+«-3jr) such that 

^t^P ® = ^Uyzi^tlip ® /))• (4.3) 

As is Theorem 13.401 for D^a(7z)> the unitary operator ^^'"^(y^) extends to a holomorphic 
semigroup of Hilbert-Schmidt operators on L^(R+, r^('''>+^+"-^cir) for Re(z) > 0. Further, there 
exists a unique kernel A^'"^V> ■^i z) for each z and meN such that 

Jr*ca 
/(.)Afj(r,.u)/<^>^^--^J., (4.4) 


holds for any / 6 L^(R+, r^<'''>*^*"-^dr). 

According to the direct sum (42), the semigroup n,t,fl(7z) is decomposed as follows: 

^kAyz)= Xi''idoQ^J(r,). (4.5) 

meN 

Comparing the integral expressions (4.1) and (4.4) of Clj. ai'Yz) and Q['"^(y^) respectively, we 
see that the kernels A/t ^(x, z) and A^™\r, s; z) satisfy the following identities: 

^AUx,y;z)p(^^fi\\ymAy)dy = p(^^ /(5)A^J(r, 5; z)^^^^^^-^ (4.6) 

for any p e ^^"'\R^) and / 6 L^(R^, r2<*^>+^+«-3jr). 
In light of the following formula for the measures 

&ay)dy = Mr])s^^'^'-'''-"-'dcTirj)ds 
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with respect to polar coordinates y = st], we see that (4.6 ) is equivalent to 

Ck.a I At_a{roj,ST];z)p{T])'&k{ri)do-{T]) = p{a))Al"^{r,s;z). (4.7) 

Therefore, the distribution A^^a is determined by the set of functions A[™^ (m 6 N) as 
follows: 

Proposition 4.1. Fix z e C with Rez > 0. Then, the distribution Ak^a(x,y; z) on R'^ x R'^ is 
characterized by the condition (4.7) for any p e ^'"(K.'^) and any m e N. 

The relation between Aj, ,, and A^™^ (m 6 N) will be discussed again in Theorem 14.201 by 
means of the 'Poisson kernel'. 



4.1.2. The case Reiz) > 0. 

Suppose Re(z) > 0. Then, Q.f^(y,) is a Hilbert-Schmidt operator on L^{R^,r^^''^-'^-"'-^dr), 
and consequently, the kernel Af'^{-, ■ ;z) is square integrable function with respect to the 
measure {rsY'''^^^^^"~^dr ds. 

We shall find a closed formula for A^"^\r, s; z). Let us fix m 6 N (as well as k and a) once 
and for all. We have given in Proposition 13^15] an explicit orthogonal basis {f(%r) : ^ 6 N} of 
L2(R+, r'^^^^^^^"-^dr). On the other hand, it follows from Theorem 3.40 (2) that Of (;?, x) = 
ff^{r)p{oS) (see (3.34)) is an eigenfunction of the Hilbert-Schmidt operator Q/; a(y,): 

^UyzWt\p,x) = e-'^^'^''--^'^'of\p,x). 
Using the identity (4.3), we deduce that 

= ^-^^''"'*-"'"^VS(^), (4.8) 

where the constant Ak^a,m is defined in (13.11b . Hence, the kernel A[™\r, s; z) in (4.4) is given 
by the following series expansion: 



1+20 



In view of the definition (13.311) of /^^^(r), A^'^^r, s; z) amounts to 

^j-iM,».2-(''*''.'"+i) r(i;t,„,™ + 1) ^ ^a ^ ^ ^a ^' 

In order to compute this series expansion, we recall some basic identities of Bessel func- 
tions. Let be the /-Bessel function defined by 

h(w) := e-5'"7,(et'w). 
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It is also convenient to introduce the normalized /-Bessel function by 

DO 



1 

V^r(i + i) J-i 



(4.10) 



2' 

We note that hiw) is an entire function of w e C satisfying 

1 



h(0) = 



Now, we can use the following Hille-Hardy identity 



rn\ \A ^^^)Lf{v)w^ = exp - ^ (mvw)-/, -^^ 

„ r(/t + K + I) I -W ^ \ -W ' ^ \ -W ' 

Hence, we get a closed formula for A'f^ir, s; z): 



''''' smh(z) • \asmh(z) 



a-^*.".'" (sinh(z))'i*-.'''"+i \ a sinh(z) 

Next, let us give an upper estimate of the kernel function A^™\r, s; z). For this, we recall 
from Il39l §4.2] the following elementary lemma. 

Lemma 4.2. For z = x + V-Tj, we set 

smh{2x) 



a(z) := 

m := 



cosh(2jc) - cos(2y) ' 
cos(j) 



cosh(x) 
Then, we have 
1) 

Recoth(z) =a(z), (4.12) 

Re-^ = a(zmz)- (4.13) 
smh(z) 

2) Ifz e C"^ \ inZ, then we have cosh(2x) - cos(2j) > 0, and 

a{z)>Q and |ye(z)| < 1. 

3) //Rez>0, then a{z) > 0. 
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We set 

C(k,a,m;z):=^—— ^ \ . . . , ■ (4.14) 

With these notations, we have: 

Lemma 4.3. For z e C"^ \ inZ, the kernel function A^'"^\r, s\z) has the following upper esti- 
mate: 

|A^;^(r, s-z)\ < C{k,a,m-z){rsrcx^[-h,r" + s")a{z){l - ^(z)|)). (4.15) 
Proof. By the following upper estimate of the /-Bessel function (see [[391 Lemma 8.5.1]) 

IMw)| < r(v + ly^e^^""^'^^ for V > and w 6 C (4.16) 

that we get 

\^^tl{r,s-z)\ < C{k,a,m-z){rsTtM-W + ^^)(Re coth(z) - Re-i— 1)). (4.17) 

^ a ^ smh(z)l^^ 

Here, we have used r" + s" > 2{rs)i. Then, the substitution of ([4T12I) and (147131) shows 
Lemma. □ 

We are ready to complete the proof of the following: 

Theorem 4.4. Lety^ = Exp(/z|_^^ be an element of S UXW) (see {3 . Alt)), and A^f^{r, s\z) 
the function defined by ([4.111) . Assume m 6 N and a > satisfy 

2m + 2{k) + N + a-2>0. (4.18) 
Then, for z e C++, the Hilbert-Schmidt operator nff (y.) on L^iR+, r^(i<)+N+a-3^^^ ^ -^^^ 

Kfys-z)f{s)s^^'^^'^''^-'ds. (4.19) 



The integral in (14.19[) converges absolutely for f e L^(R+, s'^'-^'^^^^'^'^ds). 

Proof. We have already proved the formula ( 14.1 11) for A''^^{r, s;z). The convergence of 
the integral ( [4.19 ) is deduced from the Cauchy-Schwarz inequality because A^'^^(r, ■;z) & 
L2(R+, 52»+^+«-3j^) for all z 6 C++ if (4.18) is fulfilled. ' □ 

4.1.3. The case Re{z) = 0. 

The operator Q.''^^(yy) is unitary if Re(z) = 0. In this subsection, we discuss its distribution 
kernel. 

We note that the substitution of z = ifj. into (4.11 ) makes sense as far as w ^ nZ, and we get 
the following formula 

/ TTi \(rsY'''''>'^'^^ /z \ /2(rs)'i\ 

Kflir, s; iM) = exp --(i,,,,„ + 1)V— exp -(r'' + s^) cotOu) 7,,^,„ -— • (4.20) 

^2 smyu ^a ' " \asm/// 

Here, we have used the relation /^(f) = e~'^ J x{z). 
In this subsection, we shall prove: 
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Theorem 4.5. Retain the notation and the assumption (4.18 ) as in Theorem \4.4 ! For fj. e 

R \ nZ, the unitary operator Ot^^^iyt^) on L^(R+, r^i^)+^+"-^clr) is given by 

^tl^yi,)f{r) = f{s)^['l{r,s-in)s^^''''''"-'ds. (4.21) 
Jo 

The integral in the right-hand side (4.21 ) converges absolutely for all f in the dense subspace, 
in L^(l.+, r^'-''^'^^'^"~^dr), spanned by the functions {/^^^,|}fgfj (see {3.31) for definition). 

Proof. Let e > and // e R. \ nZ. By Theorem 4.4 we have 

/(.)A«(r, e + ip)s''''-'^-"-'ds. {A.ll) 



As 6 ^ the left-hand side converges to C^l^^^iji^) by Theorem 3.40 (1). 
On the other hand, the addition formula 

csch(6)csch(z/i) 



csch(6 + ip) = 



coth(e) + coth(zyu) 
gives 

|csch(6 + ip)\ < |csch(//z)|. (4.23) 
Hence, it follows from Lemma 4.3 that we have 

(rs)'" 

|Afj(r, s- e + ip)\ < C{k, a, m; ip){rsr < C , . ) ' . , 
for some constant C. In view of (3.31), we get 

^ , ^ / ^ I r"' QX\){-- S") ^ w2 \l 

iAi:'(r, . ,»/<:;(.)| < c- |,i„J)|.:.., ^^i4^'-'(-^l 

Now, we can use the dominated convergence theorem to deduce that the right-hand side of 
(14.221) goes to 

/(.)A«(r,.;z».^<^>-^-^J. 

Jo 

as e ^ 0. Hence, Theorem has been proved. □ 



As a corollary of Theorem 14.51 we obtain representation theoretic proofs of the following 
two classical integral formulas of Bessel functions: 

Corollary 4.6. 

(1) {Weber's second exponential integral, [[241 6.615]j. 

^\-'^Ula^)Uip^)dT = 

where \ arg(5)| < | and v > 0. 

(2) (Seem, 1.421. 4]). 

f e-Lf,aT)m ^)TUt = ^±0e-'i LTi^^). (4.24) 

for Re{S) > and Re(v) > 0. 
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Proof (Sketch). (1) The semigroup law Q^7(r„)Q^;'(r,,) = q^Cr^.^^^) yields 



f A("^(r, Zi)Al"f /; Z2)s^''^''''"-'ds = Kfl{r, r';z,+ Z2). (4.25) 
Jo ' ' 



Using the expression (|4.20l) of A[™\ we get the identity (|4.25l) . 

(2) The identity (4.8) (in terms of group theory, this comes from the ^-type formula 
(|3.33 a )) can be restated as 



' ' 



in terms of the integral kernels by Theorem 14.41 After some simplifications and by putting 
constants together, we get the identity (14.241) . □ 

Remark 4.7. 1) The operatorn{Aic^a,m)(yz) nets on the irreducible representation n{Ak^a,m) of 

SL{2, R) as a scalar multiplication ifz e zttZ i.e. ify, belongs to the center (see Fact 3.27). 

Correspondingly, the kernel function A^™-'(r, s;e + ip) approaches to a scalar multiple of 

Dirac's delta function as e goes to if p 6 nZ. 
2) Of particular interest is another case where fi e n{Z + ^). For simplicity, let // = |. Then, 

the formula (4.20 ) collapses to 

A2(r, |) = exp(-|(4,.,„ + l))(r.)-<^>-^V,,„,4^(r.)f ). 
For a = \,2, we have 

AgV, |) = .-'-f (^'-2«-^-^)(r.)~«-^V2..2<.>.^-2(2 V^) (a = 1), 

Ag(r, |) = .-'■5(-<^>^^>(r.)-«-^i7,,^,,,.^,(r.) (a = 2). 

We shall discuss the unitary operator Q.{-yz) in the case // = | in full details, for which we 
call the (k, a)-generalized Fourier transform ^k,a (up to a phase factor) in Section|51 

4.2. Gegenbauer transform. 

In this section, we summarize some basic properties of the Gegenbauer polynomials and the 
corresponding integral transforms. The results here will be used in Section 4.4 to analyze the 
correspondence: 

Aj^Cr, s; t) (m G N) ^ ^U^,y\z). 
4.2.1. The Gegenbauer polynomial. 

The Gegenbauer polynomial C^jj:) of degree m is defined by the generating function 

00 

(\-2rt + r^r = YjCl{tV'. (4.26) 



m=0 



To be more explicit, it is given as 



C(o = ( - \t (1 - t'r^'^^M^ - t'T'-h (4.27) 

2 m!(y + 2)m dt"" 
where {a)m '■= a{a + I) ■ ■ - {a + m - l)is the Pochhammer symbol. 
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If we put t = COS 6, and expand 

1 -2r 

by the binomial theorem, then we have 



1 - 2r cos + = (1 - re'\l - re''^) 



C;(cos 0) = £ 



(v).(v), 



m~k 



k=0 



k\{m-k)\ 



cos(m - lk)6. 



(4.28) 



Then, the following fact is readily seen. 



Fact 4.8. 1) C^(0 is a polynomial oft of degree m, and is also a polynomial of the parameter 

V. 

2) Cl{t) = foranym> 1. 

3) Clit) = \, C\{t) = 2vt. 

r(2m + 2v) 

4) C;(l) = , . 

m!r(2v) 

In this subsection, we prove: 
Lemma 4.9. Fix y e R. Then there exists a constant B{v) > such that 



sup 

-i<f<i 



lc:,{t) 



< B(v)m^^ ^ for any m e 



(4.29) 



Remark 4.10. 1) For v > 0, it is known that the upper bound of |C^(OI is attained at t = 1, 
namely, 

sup c;(o = c;(i) = ■ 

-i<r<i m!l(2v) 
This can be verified easily by (4.28 ). or alternatively, by the following integral expression 
for V > 0: 

r(v + i)r(m + 2v) 



cut) 



f 

Jo 



it+ Vr^ - 1 COS 0)'" sin^^-^ede. 



(4.30) 



V^m!r(v)r(2v) 

2) For V = 0, the left-hand side of (4.29) is interpreted as the U°-norm of limy^o yC^(0. 
which is a polynomial oft by Fact \4.8\ 2). 

3) Our proof below works also for all v 6 C. 

Before proving Lemma 4.9, we prepare the following estimate: 
Claim 4.11. Let /I 6 R. Then there exists a constant A{A) > such that 



Y(A + k) 



< A{A)k^~^ for any 6 N. 



T{A)k\ 

Proof. We recall Stirling's asymptotic formula of the Gamma function: 

T{x) ~ Tq{x) as X ^ oo, 
where Yq{x) := y/lnx'''^ e'^ . In light of the following ratio: 



Toik + A) 

ro(fc+i) 



= k 



111 
1 + 1 



1 + - 

k 



A-l 
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we get 

Thus, Claim follows. □ 
Proof of Lemma 14791 By (|4.28l) . we have 

r(v + k) Y{m -k + v) 



sup \c:m < V 



klYiv) (m-ky.Yiv) 



We note that there is no pole in the Gamma factors in the right-hand side. We now use Claim 
I4.11[ and get 



< YjA(vfk''-\m - ky-^ 



k=0 



<A(vf(m + l){- 



m 



Iv-l 



Hence, {A. 29) is proved for v ^ 0. 
For V = 0, we use ( 4.28 ), and get 



lim -C;;(cos 6) = -(cos(n - 2m)e + cos nO). (4.31) 
v-»o V m 

Hence, the inequality ( 4.291) also holds for v = 0. Thus, we have proved Lemma 14^91 □ 
4.2.2. The Gegenbauer transform. 

We summarize -properties of Gegenbauer polynomials in a way that we shall use later. 
Fact 4.12 (see Q, M Chapter 15]). Suppose v > -\. 

1) : m 6 N} is an orthogonal basis in the Hilbert space M'y := L^((-l, 1), (\-i^Y'T-dt\ 



„ 9 9 V 1 7rr(2v -I- m) 

2) I _ - r)-* = 2^.-.r(^.i)(^.>.)r(v)^ 

3) We 5ef a normalized constant by^m by 

)2v-li 



2^''-T(m+ l)r(v)r(v+ 1) 



nY(2m + 2v) 
r/zen, the Gegenbauer transform defined by 



(4.32) 



%m(h) := Z7,,,„ J h(t)Cl^(t)(\ - t^yidt, for h £ JTy (4.33) 
has the following inversion formula. 

= - _^(m + y)K„(/i)C;(0. (4.34) 



V 

m=0 
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The orthonality relation in Fact i4.12i can be restated in terms of the Gegenbauer transform 
as follows: 

V 

{n = m), 

+ ^ (4.35) 
(n ^ m). 

The Gegenbauer transform "^y,,, arises also in a Dunkl analogue of the classical Funk- 
Hecke formula for spherical harmonics as follows. 

Fact 4.13. (see [l63l Theorem 2.1]) Let h be a continuous function on [-1,1] and p 6 
^"'(R^). Then, we have 

dk f {Vkh){aj,7])p{7])Mn)dcr(7]) = %^^^Jh)p(oj), a> e 5^'^ (4.36) 

Here, dk is the constant defined in (12.12!), and VJi is defined in (12.61) by using the Dunkl 
intertwining operator Vt- For k = 0, (Vkh)(ri, o)) = h({ri, oS)) and d^uijl) = 1, so that the 
identity (4.36) collapses to the original Funk-Hecke formula. 

4.2.3. Explicit formulas of Gegenbauer transforms. 

In this subsection, we present two explicit formulas of Gegenbauer transforms ^y„, (see 
(4.33 )). These results will be used in describing the kernel distributions Ak,aix,y',z) for 
a = 1, 2 (see Theorem 4i24l). 

Lemma 4.14. 

1) K,.(7;;_.(a(l +0^)) = 22-'";r-5a2-r(y + l)72^+2v(V2a) = ^^^^Z^^^^i^a). 

2) K,,„(e"0 = 2-W{v + 

This lemma is an immediate consequence of the following integral formulas and the dupli- 
cation formula of the Gamma function: 

r(2y) = 22^-';r-^r(y)r(v + (4.37) 

Lemma 4.15. For a,v e C such that Re(v) > 0, the following two integral formulas hold: 

(1) 

■' l_.(aO + ,)*)C(0(1 - r^r-'A = if^l":t!1 {^f"h,.M (4.38) 



i: 



.1 "-^^ ' ^ . mv.v r(m+l)r(y) ^ V2^ 

(2) 



L 



1 2"^^"'"+'7rr('2v + m) ~ 

e'^'Cim - tT-^dt = —- l^-^a'"hUa). (4.39) 

;-i r(m + l)r(v) 

Proof of Lemma 4.15 (1) This identity was proved in [39, Lemma 8.5.2]. 

(2) The integral formula (4.39) is well known (see for instance [60, page 570]). However, 

for the convenience of the readers, we give a simple proof. Using (4.27), we have 

j-1 r(2v) 2'"m!r(m + v + i) j-1 Jr' 



+ V+^) J-1 



r(v+^) r(m + 2v) , ^2,™.v- 

r(2v) 2'«m!r(m 



e"\\ - t^)'^*'-^dt. 
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Now, C 4.39I) follows from the integral representation (|4.10) of Uiw). □ 

Remark 4.16 (expansion formula). Applying the inversion formula of the Gegenbauer trans- 
form (see Fact i4.12\l , we get the following expansion formulas from Lemma \4.l4\ 

DO 

e^' = r(v) ^(v + m)(^)'XUw)C:,(t), Re(y) > (4.40) 

m=() 

/v-i/2( ) = — Yj^v + m)(-) Wv(w)C;(0, Re(y) > (4.41) 

or equivalently, 



w^'./v-i/2( ) = ^ Xi^-^^"^^ + m)72v+2M(w)C(0. 



The first formula (4.40) /5 Gegenbauer's expansion (see for instance [|62l 7.13(14)]j, whereas 
the second expansion formula (|4.41l) wa* proved in Kobayashi-Mano [l39l Proposition 5.7.1]. 

4.3. Integral representation for O.kA'Yz)' 

In this section, we find the integral kernel Ak,a(-^^ ^) of the operator O^kATz) for z&C'^\ inZ. 
The main result is Theorem 14.231 

4.3.1. The function J^(b, v; w; t). 

In this subsection, we introduce a function ^{b, v; w; t) of four variables, and study its basic 
properties. 

Let Ia{w) = Ci)~'^h(w) be the normalized /-Bessel function (see (149]) ). and C^(0 the 
Gegenbauer polynomial. Consider the following infinite sum: 



yib, y; w; t) = ^ Jj^'" + ^) ( 2 ) ^Mm+v)(w)C;(0. (4.42) 

m=() 



We note that v = is not a singularity in the summand because C° (0 = for m > 1 (see Fact 
14.81 2): see also (|4-31|) ). In this subsection, we prove: 

Lemma 4.17. 1) The summation (4.42') converges absolutely and uniformly on any compact 
subset of 

C/:={(Z7,v,w,0e]R+x]RxCx[-l,l] ■.l+bv>0]. (4.43) 

In particular, ^{b, v; w; t) is a continuous function on U. 

2) (Special value atw = 0) 

J^(b,v;0;t)= I. (4.44) 

3) (Gegenbauer transform) Forv> 

'^y,m(J^{b, y; w; •)) = r(l + bv) ^- j 4(,„+v)(w), /or m e N. 
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Proof. 1) It is sufficient to show that for a sufficiently large mo the summation over m (> mo) 
converges absolutely and uniformly on any compact set of U. We recall from (4.16) and 
(429 ) that 

\h{w)\ < 



\ciit) 



< B{v)n?^ ' for any m > 1 . 



Then, 



E 



m=mo 



W 

(m + v) ( — 



bin 



lb{m-¥v) 



m=mo 



(m + v)5(v)w^'Vl'^""'lm2''-i 



2'""r(bm + bv + 1) 
(1 + ^)m2^ 



Y{bm + bv + 1) 



Since b > 0, T{bm + bv + 1) grows faster than any other term in each summand as m goes to 
infinity, and consequently, the last sum converges. Furthermore, the convergence is uniform 
on any compact set of parameters {b, v, w). Hence, we have proved the first assertion. 

2) Since b > 0, the summand in ( 4.42) vanishes at w = for any m > 0, and therefore 

Jib, y; 0; t) = ^ ■ v ■ lUO) ■ Cl{t) 

V 

= 1. 

Thus, the second assertion is proved. 

3) This is an immediate consequence of Fact 14. 12] on the Gegenbauer transform '^y n 

Example 4.18. The special values at b = 1,2 are given by 

J{\,v;w;t) = e'", (4.45) 



1- 



w(l + 0' 



(4.46) 



^(2,y;w;0 = r(y + -)/, 
Proof of Example \4. 18\ First, let us prove the identity (I4.45|) . By Lemma 4.17 3), we have 

"^y^mi^ib, y; w; ■)) = r(l + bv) J 4(™+v)(w), for all m e N. 
By Lemma l4TT4l 2). we have 



^v,«(e"") = r(l+y)(|)"ww). 



This shows that 



'^y,™ (left-hand side) = "^v^Xright-hand side) for all m 6 N 

with regard to the identity (14.45)). Since the Gegenbauer polynomials form a complete or- 
thogonal basis in the Hilbert space L^((-l, 1), (1 - fy~^dt) (see Fact 14.121 ), we have proved 
(1445). 

The proof for the identity (|4.46i) goes similarly by using Lemma 14.141 1). Thus, Example 
3T18 has been shown. □ 
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4.3.2. The normalization constant. 

For a > and a multiplicity function k on the root system we introduce the following 
normalization constant 

Ck,a:={ f exp(--M%Ax)dxy' (4.47) 
where t^^^q is the density defined in (I1.2D . Using the polar coordinates, we have 

c-i= r r exp(--r")r2<^>+^+''-^i?Ka;)^^cr(a;)^^r 

Jo Js-v-' 

Jr»oo 
_ N+l(k)-l 
e {at) " dt. 




Here, ^ is the ^-deformation of the volume of the unit sphere (see (ILllI) ). The integral 
converges if l{k) + N + a- 2>0, and we get 

r 2(k}+N-i ^_ 2(k) + N + a - 2 
a 



Ck,a = a-^^-^^Y{^ r'd,. (4.48) 



For = 0, we have dr. ^ = j0- (see (|2.13l) ). and in particular, 

' 2 * 

r(f) ^ 1 1 

~ 2n^m - 1) " (4;r)^r(i^)' '''' ~ (2;r)f ' 
4.3.3. Definition ofh^air, s; z', t) and Ai,a(x, y; z). 

We now introduce the following continuous function of t on the interval [-1,1] with param- 
eters r,s>0, and z e \ inZ: 

cxp{-^^{r'' + s")coth(z)) (2 2{k) + N-2 2(r5)i \ 

hk,a{r,s;z;t):= ^ ^^^^ ^ ; . . , (4.49) 

sinh(z) r \a 2 asmh(z) / 

We observe that, for // e R. \ ;rZ, the substitution z = i^ into (|4.49D yields: 

exp(^(r" + /')cotOu)) /2 2{k) + N - 2 2(r5)f 



hka{r,S\iu\t) = , ;7---r — rJ^ -, ; \t\. (4.50) 

■ e^^^^-sinOu)^^^^ W 2 'a/sin(;/)'; 

We recall from (4.3) that hf^ir, s; z) is the integral kernel of the operator 0.f'^{y,) on L^{R+, r^^''^^^^"-^dr). 
Up to a constant factor (independent of m), the Gegenbauer transform of hka coincides with 
a£V,^U): 

Lemma 4.19. Suppose 2{k) + N > I. Then, for every m eN, we have 

^^,y,^_.,Jh,,a(r,s;z;-)) = —A^^(r,s;z) (4.51) 



2{k)+N-l 



«-^r|'H<i>±^)M:,v,..,. 
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Proof. We observe 

2{k) + a + N-2 2 

I + bv = and Ak am = -{m + v) 

a 'a 

if Z7 = ^ and V = M^tl_ Then, Lemma HIS follows from Lemma ^H] 3) and the definition 
(|4Jij)of Ai^V,*^). □ 

We are ready to define the following function on x x (C^ \ inZ) by 

Ak^airo), ST]-, z) : = (Vkh^air, s; z; -Mco, if), (4.52) 

where Vf, is introduced in (2.6) by using the Dunkl intertwining operator Vk and h^^^air, s; r, t) 
is defined in (i4.49i) . 

4.3.4. Expansion formula. 

For a > 0, we will derive a series representation for the kernel A,t,a in terms of A^™^ and the 
Poisson kernel of the space .^'"(R.^)- 

In fight of the definitions of ^{b, v; w; t) (see (14.421) ) and A^'"V, s\ z) (see (|4.11D ). we may 
rewrite (4.49) as 

V " / meN + ~ 

(4.53) 

The above expansion formula ( 4.531) is the series expansion by Gegenbauer polynomials (Fact 
I4.12|) corresponding to Lemma 14.191 

Now, applying the operator to (|4.53l) . we get 

Theorem 4.20. For a > and z 6 \ inZ, we have 

, 2{k)+N-i l2(k) + N + a - 2\^ x„ / X 

Ak,a(x, y, z) = a' « T I 1 2^ A\a{r, s; z)Pk,m{oj, m 



where x = no, y = srj, and 



,{k) + m+^ 



Pk,m{^,ri) := ( "^'" )(VkCT''''Yco,ri). (4.54) 

{k) + — 

In Theorem I4.20[ the function Pk^m(oj,ri) on S^~^ x S'^"^ is the Poisson kernel, or the re- 
producing kernel, of the space of spherical fc-harmonic polynomials of degree m, which is 
characterized by the following proposition. 



Proposition 4.21. Pt,„,ico,r]) is the kernel function of the projection from the Hilbert space 
L^{S^-\§k{ri)dj]) to ^'"(R^), namely, for any p e ^'"(R^), 



\ Pk,m(^, T])p(T])-&k(T])d0-{7]) = 



I p(a)) (n = m), 
lO (n^m). 
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Example 4.22. ForN = 1, S^-^ consists of two points (±1), and ^'"(R^) = Oifm> 2. In 
this case, it is easy to see 



1 (m = 0), 

lsgn(a;?7) (m = 1). 



Proof of Proposition \4.21\ By the Funk-Hecke formula in the Dunkl setting (see Fact 14. 13]) . 
we have 

dk J ^ ^ (V^C,^^^^) (ti^, T])p(r])'&k(n)d(T(T]) = '^(k)+!^,n (C^m'^^^pio)) 



2 



'■^p{oj) (n = m), 
[O (n ^ m). 

Here, we have used Fact |4.12| and (4.35') for the last equality. Hence, Proposition |4.21 [ follows. 

□ 

4.3.5. Integral representation ofQ.k,a(yz)- 

We are ready to prove the main result of this section. Recall from Theorem 3.40 that O^kATz) 
is a holomorphic semigroup consisting of Hilbert-Schmidt operators on L^(R.^, d-kAx)dx) for 
Re z > 0, and is a one-parameter subgroup of unitary operators for z e / R. Here is an integral 
representation of Q-k^y^): 

Theorem 4.23. Suppose a > and k is a multiplicity function on the root system M satisfying 

2{k) + N >maxil,2-a). (4.55) 

1) Suppose Rez > 0. Then, the Hilbert-Schmidt operator Qfc,a(7z) on L^{R'^ ,'&k,a{^)dx) is 
given by 



^k,a(yz)f(x) = Ck,a I f(y)^k,a(^^y'^z)&k,a(y)dy, (4.56) 

where Ck^a is the constant defined in (|4.47|) and the kernel function Ai,a(x,y;z) is defined 
in (I4.52h . 

2) Suppose z = ifi (jJ. & R \ 1,). Then, the unitary operator O^kATii^) on L^{R^, '&i, a(x)dx) is 
given by 

^k,a(7ifi)f(x) = Ck,a I f{y)f^k,ai^,y\il^Wk,aiy)dy. (4.57) 

Proof. Thanks to Proposition '4.1', it suffices to show the following identity: 

Ck,a I Ak,a(roJ' ■^'7; z)pir])&k(ri)do-(ri) = ^flir, s\ z)p(a)), 

for all p 6 ^'"(R^) and m 6 N. This follows from Theorem KM Proposition 431, and 
(|4.48). Hence, Theorem 4.23 is proved. □ 
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4.4. The a = 1,2 case. 

As we have seen in Theorem 4.23, the kernel function Ai,a(x,y; z) for the holomorphic semi- 
group Q.k,a(yz) is given as 

Ak^airco, ST]; z) = (Vkh^air, s; z; -Mco, tj). 

See ('2.6) for the definition of Vk- In this section, we give a closed formula of hk^air, s; z; t) for 
a = 1,2, and discuss the convergence of the integral ( 4.56 ) in Theorem 4.2_3.. 

4.4.1. Explicit formula for hi, air, s;z',t) (a = 1,2). 
Here is the formula of /iyt,a(/", s; z, t) for a = 1, 2. 

Theorem 4.24. Let (k) be defined in (2.3) . andly the normalized I-Bessel function (see (4.9 )j. 
Then, we have: 

exp(-i(r"' + 5'')coth(z)) 



hu,a{r,s;z;t) = 



smh(z) 



X 



t rst \ . ^, 

expl— — ) (a = 2), 



forzeC^\inZ. 

Proof. In view of the definition (4.49 ) of hk,a(r, s; z; t). Theorem 14.241 follows from formulas 
(14.45 ) and (4.46 ) for J^(a, v; w; t) in Example 4. 18 , □ 

4.4.2. Absolute convergence of integral representation. 

By using Theorem 4.24. we shall give an upper bound for Ak^a(x,y;z). We begin with the 
following: 

Lemma 4.25. Forb= 1,2 

|^(^,y;w;OI < e"^'""' (4.59) 
for any t e [-1,1], v > and w e C. 

Proof. We have seen in (|4^45J) and (14^46]) the explicit formulas of J^(Z?, v; w; t) fox b = 1,2. 
Then (4.59) is obvious foxb = 1, and follows from the upper estimate (14.161) of the /-Bessel 
function for b = 2. □ 

Proposition 4.26. Suppose b is a positive number, for which the inequality (4.59) holds. Let 
a '■= I- Then the function Ak^a(x,y;z) (see (4.52 )j satisfies the following inequalities: 

1) For Re z > 0, there exist positive constants A, B depending on z such that 

\AUx,y;z)\<Aexp{-B{\\xr + M")) , for any x,y 6 R^. (4.60) 

2) For z = in + e ijx e^\nZ, e > 0), 

\Ak,a{x,y; in + e)\ < (^.61) 

I smOu)| « 

Remark 4.27. By Lemma 4.25 the assumption of Proposition 4.26 is fulfilled for b = 1,2. 
We do not know if (4.59 ) holds for b other than 1 and 2. 
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Proof. Suppose the inequality (4.59 ) of ^{b, v; w; t) holds. Then, by the definition of h^^air, s; z; t) 
in (4.49). the inequality (4.59) brings us to the following estimate: 

11 2 

\hu,air,s\z\t)\ < 5^j^7^exp(— (/' + /)a(z))exp(-(r^)2cK(z)yS(z)). 

|sinh(z)|^V^ ^ a ' ' 

Here, we have used the functions a{z) and yS(z) defined in Lemma '4.21 Since + s" > 2(rs)^, 
we have obtained: 

y, z; t)\ < exp(--(r'' + s'')a(z)il - L8(z)|)). 

I sinh(z)| " 

We recall that A,t_„(jc, z) is defined by applying the operator to h^^r, s; z; •) (see (.4.52J ). 
Then, it follows from Proposition 2.4 that 

\^kAx,y;z)\ < \\hUr, s;z; < exp(--(||x|r + \\yr)a(z)(l - 

I sinh(z)| « ^ 

Suppose now that Rez > 0. Then, a(z) > and \fi(z)\ < 1 by Lemma 1421 Hence, we have 
proved (4.60). 

On the other hand, suppose z = ifi + e Qi e R \ nZ, € > 0). Then a(z) > 0, |yS(z)| < 1 by 
Lemma i4.2t and as we have seen in (|4.23^) 

I sinhzl > I sin//|. 

Hence, we have shown (|4.61|) . □ 
Now we are ready to prove: 

Corollary 4.28. Suppose we are in the setting of Theorem \4.23\ Let a = 1,2. 

1) For Re z > 0, the right-hand side of (14.561) converges absolutely for any f e L^{R^, &i,a(x)dx). 

2) For z = in & ?'(K. \ ttZ), the right-hand side of (|4.57|) converges absolutely for all f e 
{V n L2)(]R^, &k^^(x)dx). 

Proof. 1) It follows from Proposition 14.26 1) that 

AUx,y;z) e l2(]R^ X R^, &UxWk,a(y)dxdy) 

for Re z > 0. Therefore, Corollary is clear from the Cauchy-Schwartz inequality. 
2) We shall substitute z by 6 + i/u in (14.561) and let e goes to 0. 
For the left-hand side of (|4.56|) . we use Theorem 13. 401 1), and get 

e—>0 

For the right-hand side of (|4.561) . thanks to Proposition 4.26 2), we see 

lim I Ak,a(x,y;ip + 6)f(y)&k,a(y)dy = I KkAx,y\ilJ)fiy)'&k,aiy)dy 

for / 6 L^(R^, d-k,aiy)dy) by the Lebesgue dominated convergence theorem. Hence, we have 
shown that 



/ 



Ak,a(x, y, iii)fiy)'&k,aiy)dy. 
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and the right-hand side converges for any / 6 (L^ nL^)(R.^, '&k,aiy)dy)- Hence, Corollary 14.281 
has been proved. □ 

4.5. The rank one case. 

For the one dimensional case, the only choice of the non-trivial reduced root system ^ is 
M = {+1} in R up to scaling, corresponding to the Coxeter group (£ = {id, cr} = Z/2Z on R, 
where (t{x) = -x. In this section we give a closed form of Kk,a{^,y\ z) for N = I. 

First of all, for N = I and a > 0, we note that we do not need Lemma 14,19] for which 
the assumption was 2{k) + N > I. Hence, instead of (|4.55b . we simply need the following 
assumption: 

a > and 2{k) > I - a. (4.62) 

The goal of this section is to find a closed formula of the kernel function A^. ^(x, y; z) (see 
(|432j)) for all a > and for an arbitrary multiplicity function subject to (j4j62j). 

Proposition 4.29. Let N = I, a > 0, and 2{k) > I - a. For z 6 \ /ttZ, the holomorphic 
semigroup ^^A:,a(•y^) on L^(R, \x\^'^^'^''^dx) is given by 

where 

^^ 2fc + a-l ^ g4(N''Wcoth(z) 2 \xy\i ^ 1 xy ~ /2^# u 

^ « ' sinh(z)^ ^ " ^asmh(z)^ as sinh(z)s " ^asmh(z)^^ 

(4.63) 

Here lyiyv) denotes the normalized Bessel function (14.91) . 

Proof. By Theorem I4.20[ the kernel hk,a{x, y\ z) can be recovered from a family of functions 
{A^'^^r, s;z) : m e N}. In the rank one case, 5° consists of two points, and correspondingly. 
Theorem 14.20 collapses to the following: 



J^k,a{x,y\z) 

= ^(aJ«(|.^|, \y\-z) + A['l(\x\, \y\;z) sgnixy)) 



2 

2 smh(z) ^ •^asmh(z)^ •^asmh(z)^ 

^-i ^-i(l,|.Hvr)cothfe) 1 ^ r2 \xy\i , xy ~ .2 \xy\i 

2 sinh(z) ^(a sinh(z))-**.«.« '^'"■"^a sinh(z)^ ^ (a sinh(z))-^*^.' ^a sinh(z)^^' 

where 

2k - I 2k + I _i ^ (2tJ.) /2k + a-\\ 

h,afl = , '^k,a,l = , = 2a' - T( . 

a a ' ^ a ' 

Here, we have used Example 4.22 for the first equality, and the formula (14.201) of A[™^ for the 
second equality. This finishes the proof of Proposition 4.29, □ 
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5. The (k, a)-GENERALizED Fourier transforms ^i, a 
The object of our study in this section is the {k, a)-generalized Fourier transform given by 

ni , 2{k)+N+a-2 ^ / JTl ^ \ 

^Ka = e^^^^^cxp(-{\\x\t"A, - \\x\n). 

This is a unitary operator on the Hilbert space L^(R^, §k,a{x)dx). 

As we mentioned in Introduction, the unitary operator ^k,a includes some known trans- 
forms as special cases: 

• the Euclidean Fourier transform [|3T| {a = 2,k = 0), 

• the Hankel transform [291 (a = 1, = 0), 

• the Dunkl transform &k {a = 2,k > 0). 

In this section, we develop the theory of the (fc, a)-generalized Fourier transform ^/. ^ for 
general a and k by using the aforementioned idea of 6l2-triple. The point of our approach 
is that we interpret ^i, a not as an isolated operator but as a special value of the unitary rep- 
resentation Q.k,a of the simply connected, simple Lie group S L(2,K) at (see (3.36)), or 
as the boundary value of the holomorphic semigroup. Then, we see that many properties of 
the Euclidean Fourier transforms can be extended to the {k, a)-generalized Fourier transform 
by using the representation theory of 5L(2, R.). Our theorems for ^^. ^ include the inver- 
sion formula, and a generalization of the Plancherel formula, the Hecke formula, the Bochner 
formula, and the Heisenberg inequality for the uncertainty principle. 

As in Diagram 1.4 of Introduction, the Hilbert space L^(R'^, &k,ai^)dx) admits symmetries 
of G X 5 L(2, R.) for general (k, a), and even higher symmetries than £ x S L(2, R) for particular 
values of (k, a). In fact, if k = 0, then the Hilbert space L^(R^, ■&k,a{x)dx) is a representation 
space of the Schrodinger model of the Weil representation (see [|20l and references therein) 
of the metaplectic group Mp(N, R) for a = 2, and the -model of the minimal representation 
(see [|4T|) of the conformal group 0(N -i- 1,2) for a = 1. The special value a = 2 has a 
particular meaning also for general k in the sense that ^1, 2 is equal to the Dunkl operator 
How about the a = I case for general kl The unitary operator 

M:=^k,i (5.1) 

may be regarded as the Dunkl analogue of the Hankel-type transform ^0,1 (see Diagram !!] 
in Introduction). As we have seen in Section 4.4, this unitary operator ^ can be written 
explicitly by means of the Dunkl intertwining operator \4 and the classical Bessel functions 
(see Section 5.3). 

5 .1. JFk,a as an inversion unitary element. 

The (k, a)-generalized Fourier transform ^k,a on L^(R^, '&k,a{^)dx) is defined as 

^k,a := e'5(^^)Q,,,(7,-|). (5.2) 

Here, we recall from (3.36) that 

= Exp(^k) = Exp(^ 1^ j) 

is an element of the simply connected Lie group 5L(2, R), and from Theorem 3 . 3 1 1 that Q.k^a 
is a unitary representation of SL{2, R) on the Hilbert space L^(R^, §j^ a{^)dx). 
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In this subsection, we discuss basic properties of ^k.a for general k and a, which are derived 
from the fact that jm is a representative of the non-trivial (therefore, the longest) element of 
the Weyl group for 5I2. 

Theorem 5.1. Let a > Q and k be a multiplicity function on the root system ^ satisfying the 
inequality a + 2{k) + N > 2 (see (3.29)). 

(1) (Flancherel formula) The (k,a)-generalized Fourier transform a '■ L}{^^ ,'&k,a{^)dx) 
L^(R^, d'k^aixjdx) is a unitary operator That is, ^k,a is a bijective linear operator satis- 
fying 

mAf)\\k = 11/11. for any f e L\R\ &U^)dx). 

(2) We recall from (i3.27i) that (Df\p, •) is a function on defined as 

^f\p,x) = pW4-'*''"'^(H|;c|r)exp(-^|Uir), X 6 R^, 

for ^, m e N and p 6 ^""(R^). Then, ^f\p, ■) is an eigenfunction ofJ^ka-' 

^U^f\p, ■)) = e-'''^'^'^W;\p, •). (5.3) 

Proof Since the phase factor in (5.2) is modulus one, the first statement is an immediate 
consequence of the fact that Q^- q is a unitary representation of S L(2, R) (see Theorem 1331J). 

To see the second statement, we recall from Proposition 3.12 1) and Theorem 3.19 that 
^f\p, •) is an eigenfunction of a)k,aO^)- Then, the integration of (.3.32 a) leads us to the 
identity (5.3). □ 

Corollary 5.2. The {k, a)- generalized Fourier transform ^^^a is of finite order if and only if 
a £ Q. If a is of the form a = ^, where q and q' are positive integers, then 

(^,,J2,^.^_ 

Proof. We recall from Proposition 3^121 3) that 

Wk,a{^^) = C-span{05,^^(p, •) K 6 N,m e N,p 6 .jq"(R^)} 

is a dense subspace in L^(R'', &k aix)dx). Hence, it follows from (5.3 ) that the unitary operator 
^k^a is of finite order if and only if a 6 Q. If a = ^, then {^k,af''' acts on 0^"\p, •) as a scalar 
multiplication by 

i^^-i^it^Vf = 1 

for any m e N and any p e ^'"(R^). Thus, we have proved (^k,a)^'^ = id- n 

Corollary 15 .2l implies particularly that ^ := 1 (see (|5.1I) ) is of order two, and the Dunkl 
transform = 2 is of order four. We pin down these particular cases as follows: 

Theorem 5.3 (inversion formula). Let kbe a multiplicity function on the root system M. 
1) Let r be any positive integer. Suppose 2{k)+N > 2-K Then, ^^\_ is an involutive unitary 
operator on L^(R^, i{x)dx). 'Namely, the inversion formula is given by 

{^kiT'-^ki- (5.4) 
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2) Let r he any non-negative integer. Suppose 

2{k)+N>2--^. 

2r + I 

Then, '^k,j^ unitary operator of order four on L^(R.^, _2_(x)Jx). The inversion 
formula is given as 

{^;\ f)(x) = (^,2f){-x). (5.5) 

Proof. The first statement has been already proved. In the second statement, we remark that 
the inversion formula (|5.51) is stronger than the fact that (^k,a)^ = id for a = To see 
(15.51) . we use (1531) to get 

(^k,a?<^'^f(p, •) = exp(-m(2r + l)m)(l>f\p, •) 

= (-iro;"\p,-) 

if a = Since p{-x) = {-lYp{x) for a polynomial p of degree m, we have shown that 
(1531) holds for any / 6 Wk,a{^^). Since Wk,a{^^) is dense in L^{Ml^ , &k,aix)dx), we have 
proved (I5.5D . □ 

Remark 5.4. Theorem 15.51 2) for r = (i.e. #jt,2 = the Dunkl transform) was proved 
in Dunkl [ 1 1 J, and followed by de Jeu [[33l where the author proved the inversion formula 
for -valued root multiplicity functions k. Our approach based on the SL2 representation 
theory gives a new proof of the inversion formula and the Plancherel formula for ^k,a even 
for a = 2. 

Remark 5.5. We recall from Theorem \3. 32\ that L^(R^, '&k,a{x)dx) decomposes into a discrete 
direct sum of irreducible unitary representations ofG = S L(2,R). Hence, the square {^k,af' 
acts as a scalar multiple on each summand of (3.42) by Schur's lemma because jm is a 
central element ofG (see (3.37)) and {^k,af' = e^^^ ^^k,a{'Yni) by (5.2). Since y„i acts on 

the irreducible representation n{Xk,a,m) a scalar e-^'W«:.«.">+i) Fact 3.27 (5), acts on it 
as the scalar 

2(k)+N+a-2 1 Y) ,N 2mm 
)^-m(Ak,„j„ + l) _ g — ^ 

This gives us an alternative proof of Corollary [572\ 

Next, we discuss intertwining properties of the (k, a)-generalized Fourier transform ^k,a 
with differential operators. Let E = ^jdj be the Euler operator on as before. 

Theorem 5.6. The unitary operator ,^k,a satisfies the following intertwining relations on a 
dense subspace ofL'^{R^, ■&k,a{x)dx): 

1) ^k,a oE = -{E + N + 2{k) +a-2)o 

2) ^k,a O \\xr = -\\x\\^-"Ak O ^k,a. 

3) ^k,ao\\xf-"Ak = -\Wo^,^^. 

If we use ^ (instead of x) for the coordinates of the target space of c^k,a, we may write 
Theorem 5.6 2) and 3) as 

^uw ■ rm) = -mf'Ak^um), (5.6 a) 

■ \t"^kf)i^) = -mr-^um)- (5.6 b) 
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Proof of Theorem 5 6 We observe that is a representative of the longest Weyl group ele- 
ment, and satisfies the following relations in 5I2: 

Ad(7^)h = -h, Ad(y^)e^ = -e~, Ad(7^)e" = -e"^, 

(see (|3.1|) for the definition of e^, e , and h). In turn, we apply the identity 

^Ug)o^kA^)^Usr' = coU^d{g)X), {geG,Xe g), 
to = cok,a{^'^), E"^ = (jJk,a{^'), and H^,,„ = 0Ju,aQ^) (see dSTH). Then we have 

^Ka O mk,a = -m,a O J^k,a, (5.7) 

^,,,oE,-, = -E,+_,o^,^„ 

because ^k,a is a constant multiple of Qi^^iy;^) (see (|5.2|) ). Now, Theorem 5.6 is read from 
the explicit formulas of E^^, E^ ^, and H^- a (see (13.31)). □ 

5.2. Density of {k, a)-generalized Fourier transform ^^^q. 

By the Schwartz kernel theorem, the unitary operator ^k,a can be expressed by means of a 
distribution kernel. By using the normalizing constant Q o (see (|4.47|) ). we write the unitary 
operator ^'^^ on L^(]R^, d-)^a{^)dx) as an integral transform: 

^kJ{0 = Ck,a r BU^,x)f{x)&Ux)dx. (5.8) 

Comparing this with the integral expression of Q/t,a(7j in Theorem 14.23 '. we see that the 
distribution kernel B^^ai^, x) in (5.8 ) is given by 

BkA^, y) = e"'^^^^A,,a[x, y; i-) (5.9) 

because ^k,a = e'"^'''''^^^" '■'^^^(y/i) (see (5.2)). 

Now, Theorem 5.6 is reformulated as the differential equations that are satisfied by the 
distribution kernel Bi^ ^ix,^) as follows: 

Theorem 5.7. The distribution Bi, a(-, •) solves the following differential-difference equation 

on R^xR^ 

E''BU^,x) = E^BU^,x), (5.10 a) 

mf^^BU^, X) = -WxTBuM, X), (5.10 b) 

\\xf-"AlBU^,x) = -mrBtA^,x). (5.10c) 
Here, the superscript in E'^, A^, etc indicates the relevant variable. 

Remark 5.8. For a = 2, Theorem 5.7 was previously known as the differential equation of 
the Dunkl kernel (cf. [fTO| ). 

Proof of Theorem 5.7. First we use the identity (5.1) as operators on R.^ for any a > and k. 
It is convenient to write 

Ut,a = -(£ + 2EX 
a 
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where E is the Euler operator and £ := N + 2{k) + a - 2. Then, by (|5.81) . the identity (|5.7|) 
implies 

r ((£ + 2E'')f(x))Ba^,x)&U^)dx = - f f(x){e + 2E^)B,,a(^,x)&Ux)dx (5.11) 

for any test function f{x) (i.e. f(x)'&k,aix)^ ^ ^(R^)). 

Now we recall that the density ^k,a(^) (^^^ (1-2) for definition) is homogeneous of degree 
a - 2 + 2{k) {=€- N), we have 

E'-^M = {£ - N)^U^). (5.12) 
On the other hand, it follows from Xj-^ - 2yLi = -N as operators, we have 

r (£Y)W^W^-^ = - r /(^)(A^ + £^)g(x)Jx (5.13) 
Combining (I5.12|) and (5^131) . we have 

the left-hand side of (CTl) = - f f{x){iBu „(^, x) + 2£^5^ ^(^, x))§k a(x)dx. 

Jr'v 

Hence, the identity (|5.ill) implies that the distribution kernel B^ ai^, x) satisfies the differential 
equation 

E''BuM,x) = E^BU^,x). (5.14) 
Next, the identity (15.6 ab implies 

r 5,,„(^,^)iuir/wi^MW^^ =-11^11'"" Af r 5,,,(^,.^)/(x)i?,,,(.^)jx 

Jr'v Jrw 

for any test function /. Hence the second differential equation (15.10 bb follows. 
Finally, by the identity (5.6 b), we have 

r 5,,,(^,x)(iuii2-^'A,Y(.^)W,(.^)j.^=-ii^ir r BkM,x)f(x)dx. 

Jr" Jrw 
Since ||.jc|P~''A^ is a symmetric operator on L^iR^, ■&k^a{x)dx), the left-hand side is equal to 

r |Uir''(A,^5,,,(^, x))f{xWk,amx. 

Hence the third differential equation (|5.10 cl) is proved. □ 

We continue basic properties on the kernel B^ ai^, x) of the {k, a) generalized Fourier trans- 
form. 

Theorem 5.9. 

1) BU^x,^ = BU^,A^) forA> 0. 

2) BUhx,hO = BUx,^)forheii. 

3) Bt.a{^,x) = BUx,0- 

4) Bk,aiO,x) = l. 
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Proof. 1) This statement follows from the differential equation (5.10 a) given in Theorem 5.71 

2) Since ^k,a commutes with the aciton of the Coxeter group d, the second statement 
follows from the fact that d^k,a{^)dx is a d-invariant measure. 

3) Putting // = f in ( 4.501) . we get 

2 ' \a 2 ai 

In particular, we have 

In view of (I4.52|) and Proposition i2.4t we conclude that 



, ni ^ (2 2{k)+N-2 2{rs)i i 
hdr, s;-;t) = e ^^-^ -, ; r . (5.15) 



Hence, the third statement has been proved. 

4) By Lemma 4.17, 0; f; = g-^***^"/" Since the Dunkl intertwining operator 
satisfies Vk^X) = 1 (1 is the constant function on R^) (see (12) in Section 2), it follows from 
(I432D that A^,«(;c, y\ f ) = g- '<'>f Finally use (|5JD- □ 

5.3. Generalized Fourier transform ^k,a for special values at a = 1 and 2. 

In this subsection we discuss closed formulas of the kernel Bk^ai^, y) of the (k, a)-generalized 
Fourier transform ^k,a (see (5.8)) in the case a = 1,2. The (fc, a)-generalized Fourier trans- 
form .^k,a reduces to the Dunkl operator ^k ^ici = 2, and gives rise to a new unitary operator 
J^k, the Dunkl analogue of the Hankel transform if a = 1. 
We renormalize the Bessel function of the first kind as 



= (5.16) 
Then, from the definition (14.9) of Iy(z) we have 

Jy(w) = lyi-iw) = Iy{iw). 

By substituting z = f into (|4.58l) . we get the following formula: 

m /r(<^) + ^)e-T(2W+^-i)7;,^,^(V2(r.)^(l+0^) (« = D, 
/^a'-,^, 2''''"|e-f«^Hf),-'- (a = 2). 

Together with (5.9) and (4.52), we have: 

Proposition 5.10. In the polar coordinates x = rio andy = srj, the kernel Bk,a(x,y) is given 
by 

= |'1<*> " ¥)(^^.(4.^( V2?5aT0)))(«.,) (a - 1). , 
\yAe-"-))(oi,n) (a = 2). 

As one can see form (|5.171) . the kernel Bk 2(x, y) coincides with the Dunkl kernel at (x, -iy) 

(cf. iini). 
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Theorem 5.11. Let k be a non-negative wot multiplicity function, a = 1 or 2, and x,y e R^. 
Then \Bi,^aix,y)\ < 1. 

Proof. Theorem 5. IT follows from the special case, i.e. = j, of Proposition l4.26l 2) because 
\BU^,y)\ = |AU-^,j;/f)|by(5.9). □ 

Remark 5.12. For a = 2it was shown that \Bk^2(x, y)\ is uniformly bounded for x,y e MJ^ first 
by de 7eM [[33l and then by Rosier 11501 by 1. 

We note that Theorem 5.11 implies the absolute convergence of the integral defining ^k.a^ 
for a = 1, 2, on (L' n L^)(R^, &k,a(^)dx), as we proved in Corollary 4.28, 

5.4. Generalized Fourier transform ^i,,a in the rank-one case. 

This section examines ^k,a and its kernel Bi^ ^ix, y) in the rank-one case. 

Suppose A'^ = 1, a > 0, and 2k > I - a. Then, by the explicit formula of the kernel At^a 
(see Proposition 4.29 ), followed by the formula (5.9), we get 

Bk,a(x,y) = e^-^ « 'Ak,a(x,y;i-) 



/2k + a-\\/~ /2 a\ xy ~ /2 aw 

= r )iJ2^i-\xy\A + ^Jn^(-\xy\-A), (5.18) 

V a - ^a > (ai)l " ^a " 



where Jv{w) = Iy{-iw) is the normalized Bessel function given in (|5.16D. Thus, for a > 0, 
k eR such that 2k > \ - a, and / 6 L^(R, \x\'^'''^"~^dx), the integral transform ^^^a takes the 
form 

^,J(y) = 2-ia-(^) r fix)(Z_^(-\xyfA + ^7a^(-|xy|S))|x|^^-^Jx 
Remark 5.13. If we set 

BZTi^,y) ■■= \[BUx,y) + BUx,-y)\ 

/2fc + a - \\~ /2, n\ 

= r( )j2^(-\xy\A 

^ a ' " ^a ' 

Then, the transform ."^kAf) of an even function f on the real line specializes to a Hankel 
type transform on R+ . 

Let us find the formula (5.18") by an alternative approach. First, for general dimension R^, 
by composing ( 5.9) , (4,.52) , and (5.15), we have 

r. . . i^r 2{k) + N-2 2{rs)-2 

\ 2 ai '} 

in the polar coordinates x = rto, y = srj. Furthermore, in the = 1 case, a closed integral 
formula of the Dunkl intertwining operator \4 is known: 



Y(k + -) 

(VkfXx) = — — f- f(tx)(l + 0(1 - t'f-'dt, (5.19) 
1 {k)l (t) J-1 
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see [fm Theorem 5.1]. Hence, we might expect that the formula (5 .18) for the kernel Bi, a{x, y) 
could be recovered directly by using the integral formula (5.19) of Vj,. In fact this is the case. 
To see this, we shall carry out a compution of the following integral: 

BU^,y) = ——^^ y(-,——,^^;t{aj,r]))a+t)il-t^f-'dt (5.20) 
T{k)r(j) J-i 2 ai ' 

for X = rio, y = srj {r, s > 0, a),ri = +1). 

We notice that the summation (4.42 ) for y{b, v; w\ t) is taken over m = and 1 if = 1 . 
Hence we have 

/2 2^-1 2(r5)f X /2fc + a-K/~ a\xy\^. {2k^\)txy~ >2\xy\^A 

— - — ; —\t{io,r])] = n jU^tdl + 2 • 

2 ai ' ^ a '\ " ^ a ' (^ai)« " ^ a ') 

On the other hand, by using the integral expression of the Beta function and the duplication 
formula (4.37 ) of the Gamma function, we have 

T{k + \) . 

2 ' r{l + t){\-ff-^dt = 



Jo 



1 (m = 0), 

1 

(m = 1). 



\2k+\ 

Substituting these formulas into the right-hand side of (i5.20D we have completed an alterna- 
tive proof of (5.18). 

5 .5. Master Formula and its applications. 

5.5.1. Master Formula. 

We state the following two reproducing properties of the kernel Bk^a of basic importance. 

Theorem 5.14. (Master Formula) Suppose a > and k is a multiplicity function satisfying 
2{k)+N > max(l,2-a). 

1) For x,y e R^, we have 

Ck,a I exp(-\\u\\")Bk,a(x,u)Bk^a(u,y)&k,a('^)du 

= e"^(^^)exp(--(|Uir' + \\y\n)BkA^,y). (5.21) 

2) Let p be a homogeneous polynomial on of degree m. Then we have 

exp( — ||Mir)(exp(-— II • \\^'"Ak)p)(u)Bt,a(x^ u)&k,a(u)du 
_N a Za 

= exp(-i|Uir)(exp(-^|| • |p-A,)p)(x). (5.22) 

Remark 5.15. For a = 2, the reproducing properties <15.21} and ([5^22)) were previously 
proved in Dunkl [|T2l Theorem 3.2 and Proposition 2.1]. In that case, theses properties played 
a crucial role in studying Dunkl analogues ofHermite polynomials (see [|52l Section 3]j, the 
properties of the heat kernel associated with the heat equation for the Dunkl operators ( see 
[|52l Section 4]), and in the construction of generalized Fock spaces (see [5^ Section 3]). 
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5.5.2. Proof of Theorem 5. 14\ 

We begin with the proof of (15.211) . From the semigroup law 

^kAyzi)^k,a{yz2) = ^kAyzt+zi)' for Tzi ^ 7z2 ^ ^W), 

the integral representation of 0.j, a(jz) (see Theorem 14.231) yields 

Xn n n 

^k,a(x, u; i-)Ak^a(u,y; i-)&k,aiu)du = I^k,aix,y; i-). (5.23) 
« 4 4 I 

We set 

H := 2{k) + N + a-2. 
In view of (|4.49|) . a simple computation shows 

h,a{r,s;^;t) 



= 25^ exp(-(r" + s")). 



hk,ai2-^r,s;f,t) 
Applying Vt, and using (4.52), we get 

Ak,a(x,u; j) = 2^ exp(^(|Uir + ||a|r))A^,,(2«x, m; j) 

= ile-^'T' exp(^(|Uir' + WuT^BU^'^x, u). (5.24) 

In the second equality, we have used (5.9). By substituting (5.24) and (|5!9]) into (|5.23|) . we 
get 

Q,, r exp(-||M|rW,,(2^.^,M)5,,„(2^M,>')7?i,,(M)c^M = 2-^^e<exp(--(|Wr^ 

Since 5j.,„(2«.x:, m) = B^^aix, 2«m) (see Theorem 15.91 D) and ■&k,a{^)du is homogeneous degree 
+ 2(fc) + a - 2 = /i, the left-hand side equals 

2~~-Ck,a I exp(-||M||'')5^,a(.)C,M)5i^a(M,3;)l^i,«(M)jM. 

Hence, (5.21) is proved. 

The remaining part of this subsection is devoted to the proof of the second statement of 
Theorem 5.14. 

We recall from (13.31) and (|3.6) that 

_,, /O 1\_ 



are infinitesimal generators of the unitary representation f2jt_a of S L(2, R.) on L^(R'', '&k a(x)dx). 
We set 

Co := Exp i |[j Exp [Jj , (5.25) 
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and introduce the operator 

:= exp(/E,+J exp(^E,- J = exp(-i||x|r) exp(-^|U|p-"A,). (5.26) 
Then, the following identity in 5I2, 



leads us to the identity of operators: 

^k,a o a;,,,(h) = coU^) o (5.28) 

Since Hjt.a = <^*:,a(h) acts on homogeneous functions as scalar (see (3.3)), we know a priori 
that homogeneous functions applied by a are eigenfunctions of tOk^ai^)- Here is an explicit 
formula: 

Proposition 5.16. For £,meMandpe ^"(R^), 

Proof. We recall from Lemma 'XV that the linear map 

: C~(R^) C~(R+) ^ C~(R^ \ {0}), (;?, (A) ^ p(^)'A(IUir) 
satisfies the following identity on e^'"(R^) O C"'(R+): 

exp(^E, J o r,,, = r,,, o (id®exp(-^(r^ + (i,,,,,„ + 1)^)))- (5-29) 
Applying (15.291) to /> O /, and using Proposition |3.lU we get 

exp(^E, J o TUp ® r')(x) = TUp ® (-'^' t\Lf -""'^(^r)){x) 

= (-^)V!p(.)4^-->(^ii.ir). 

Hence, 

^kAp(MMf) = exp(/E,+j exp(^E,- Jr,,,(;? ® /) 

= (-^)'^!M^)exp(-i||;c|r)4''--^(^||x|r') 

Thus, Proposition 5.16 has been proved. □ 

Remark 5.17. Let p e ^'"(R^). By (3.3), a)k,aO^) '^^^^ on p{x)\\x\\''^ by the multiplication of 
the scalar Xk^a,m + 1+2^. Hence, 6t»jt,a(k) acts on (S>f \p, x) as the same scalar Aj, a,m +1 + 2/". 
This gives an alternative proof of the formula ( 3.32 a) in Theorem 3.19, 
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We now introduce the vector space 

^«(R") := C-span{;?(;c)||;c|r'^ : p e ^'"(R^) for some m e N, ^ e N}. (5.30) 

For a = 2, ^2(R-^) coincides with the space ^(R^) of polynomials on R^ owing to the 
following algebraic direct sum decomposition (see [[51 Theorem 5.3]): 

CO [ 

^(R^) ^00 \\x\\^'jq"-^\R''). 

m=0 e=Q 

We introduce an endomorphism of ,^„(R^), to be denoted by (e~'°)*, as 

(e-''^)\p{x)\\x\f) := e''^^^^^''p(x)\\x\f, for p e J^\R^) and £ eM. (5.31) 

Remark 5.18. The notation (e~'«)* stands for the 'pull-back of functions' on the complex 
vector space given by 

(e-'^)V(z) = f(e''h). 

However, taking branches of multi-valued functions into account, we should note that (e"' ° ) 
id for a = ^. 

The next proposition is needed for later use. 

Proposition 5.19. For a > 0, the following diagram commutes 

^,(IR^) L^iR'',&ax)dx) 



(e-'ay 



^,(R^) L^R!" ,§Ux)dx) 

Proof The identity ("5.28) in 5I2 lifts to the identity 

^k,a o ^^^(Exp ? h) = Q^,„(Exp ? k) o 

and in particular 

^k,a ° ^^^(Exp Jh) = Qi,a(Exp Jk) o 

on ^a(R^) where the both-hand sides make sense. In terms of the (k, a)-generalized Fourier 
transform ^k.a (see (\5.l!i ). we get 

fm2{k) + N + a-2^ 
2 a /---"V— - 

On the other hand, we recall from (3.6) that 



/ni 2{k) + N + a - 2\ ^ / ;r,\ _ ^ 



24^ ^ N + 2{k) +a-2 



a ^ a 

7=1 



and therefore its lift to the group representation is given by 

(D,,,(Exp ? h)/)(x) = oxp( ^^^^^^^''~^ t)f(e"^x). (5.32) 
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Substituting f = f., we get ^k,a°[e''") = '^k,a°^k.a- Thiscompletestheproof of Proposition 
i5.19i ' □ 

When k = and a = 2, ^0,2 coincides with the inverse of the Segal-Bargmann transform 
restricted to ^(R^) = ,^o,2(R^) (cf. [21, p. 40]). We may think of e^^,„ as a {k, a)-generalized 
Segal-Bargmann transform. We are ready to prove the second statement of Theorem ,5. 14, 

Proof of Theorem 5.14 2). In view of Proposition 5.19, we have c^k,a ° ^k,a(P) = ^k,a ° 
{e~'^)*{p). Since )*/)(x) = e"^ p{x) for a homogeneous polynomial of degree m, we get 

^k,a0^kAP) = e''^mAP)- 
Hence, the reproducing property (i5.22|) is proved. □ 

5.5.3. Application of Master Formula. 

As an immediate consequence of Master Formula (see Theorem 15. 14|) . we have: 

Corollary 5.20. (Hecke type identity) If in addition to the assumption in Theorem \5.14\ 2). 
the polynomial p is k-harmonic of degree m, then ( 5.22.) reads 

^kAe-'^pm = e-'^'"e-^"^">(^). (5.33) 

Corollary 15 .201 may be regarded as a Hecke type identity for the (k, a)-generalized Fourier 
transform c!^k,a- An alternative way to prove this identity would be to substitute for £ in 
(|5.3). 

The identity ('5.33') is a particular case of Theorem '5 . 2 1 below. For this, we will denote by 
Ha^y the classical Hankel transform of one variable defined by 



Ha,m{s) :-- 



if,(r)jJ-{rs)^-)r'"''^'^-'dr, (5.34) 
' 



for a function ^ defined on R+. Here, 7y is the normalized Bessel function Jyiw) = Qj) ^ Jv{w) 
(see (4.9)). Then the {k, a)-generalized Fourier transform ^k,a satisfies the following identity: 

Theorem 5.21. (Bochner type identity) If f e (L^ D L^)(R^, '&t,a(.^)dx) is of the form f{x) = 
p{x)il/(\\x\\) for some p e ,y^^"(R^) and a one-variable function ij/ on R+, then 

^kAfm = — ^e~'-^'"p{^) 2,...2,.HN-2 (mm. 

' a 

In particular, if f is radial, then ^k,a(f) <^lso radial. 

Remark 5.22. The original Bochner identity for the Euclidean Fourier transform corre- 
sponds to the case a = 2 and k = 0. For a = 2 and k > 0, Theorem 5.21 corresponds 
to the Bochner identity for the Dunkl transform which was proved in For a = 1 and k = 
it is the Bochner identity for the Hankel-type transform on R^ (see Il39l ). 

Proof of Theorem 15^21] It follows from KM that 

A^:!{r, s; |) = exp(-|(4,.™ + l))(r.)-<^>-^^7,,,„,„,(^(r.)f ) 

= a-''--"'{rsr exp(-^(4,«,,« + l))TA,^,„(^(rsy^). (5.35) 
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We set i/f,nif) '■= r'"il/{r). Since p is homogeneous of degree m, we have 
From the definition of the unitary operator Q.^^^(y^) (see (|4.31) '). we get 

^kA7z)m = p{x)\\x\rn[";^(rM\\x\\) 

Jr*oo 


Substituting (5.35 ) into the above formula with z = we get 



Now, Theorem 5.21 follows from (5.2). □ 
5.6. DAHA and S L- action. 

In this subsection we discuss some link between the representation Q.k.a of 5L(2, R.) in the 
a = 2 case and the (degenerate) rational DAHA (double affine Hecke algebra). To be more 
precise, we shall see that our representation ^^. 2 of 5L(2, R.) induces the representation of 
SL{2, C) (or the projective action of PSL(2, C)) on the algebra generated by Dunkl's opera- 
tors, multiplication operators, and the Coxeter group (see (5.42) below), and that its restriction 
to 5L(2, Z) coincides with a special case of the SL{2, Z)-action discovered by Cherednik |l6l. 
The authors are grateful to E. Opdam for bringing their attention to this link. 

We begin with an observation that if Q is a representation of a group G on a vector space 
W then we can define an automorphism of the associative algebra End(V7) by 

A^Q.{g)AQ.{g)-\ geG. (5.36) 

We shall consider this induced action for G = 5L(2, R.), Q. = Q.1, 2 (see Theorem |3.31D , W = 
the vector space consisting of appropriate functions on MJ^. 

Remark 5.23. We do not specify the class of functions here. Instead, we shall use the formula 
(|5.36) to define algebraically the G-action on a certain subspace of End(V7). The point here 
is that the G-action on such a subspace will be well-defined even when the group G may not 
preserve W. 

We begin with a basic fact on Dunkl operators on R.'^. For ^ 6 R'^, we define the multipli- 
cation operator by 

M^f{x) :={^,x)f(x). 

Choose an orthonormal basis ^i, . . .,^f^ in R'^. As in Section 2.2, we will use the ab- 
breviation Ti{k) for Dunkl operators T^k), and Mj for M^.. Then we have the following 
commutation relations: 

K Y 12 1 ^ j ^ ^- (5.37) 
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Since the formula (I5.37i) is symmetric with respect to i and j, we have: 

iUk), Mj] = [Tjikl Mi] for any 1 < /, j < N. (5.38) 
Furthermore, we have the following formulas: 

Lemma 5.24. Let ^eR^ andse C. 

1) [Ak,M^] = 2T^{k). 

2) e'^'M^e-'^' = + 2sT^(k). 

Proof. 1) It is sufficient to prove the formula for ^ = (j = I, . . .,N). 
By using (5.37), we have 

[T^(k),M^^] = Uk)[T,ik),Mj] + [mXMjmik) 
Summing them up over /, and using the following relations: 

N 

J]{a,^i)m) = T^(k), 

i=l 

Ta(k)ra + r^Taik) = 0, (see (Dl) in Section 2.1), 

we get 

[Ak,M^^]=2Tjik). 

2) The second statement is straightforward from the first statement. □ 
Let us consider the induced action of G on End(W^) (see Remark .5. 23]) . 
Proposition 5.25. We fix a non-zero ^ e R^. 

1) The induced action of Qta by (5.36) preserves the two dimensional subspace 

Cj := CM^ + CT^ik). 

2) The resulting representation ofSL{2,R) on C| descends to 5L(2, R), and extends holo- 
morphically to S L(2, C). 

3) Via the basis {M^, T^(k)], the representation ofSL{2, C) on C| is given by 

cp:SL{2X)^GLc{C]\ ^) ^ ) • (5-39) 

Proof. 1) Since 5L(2, R) is generated by Exp(?e"^) and Exp(?e") {t e R), it is sufficient to 
prove that the subspace CM^ + CT^{k) is stable by the induced action of these generators. In 
light of the formula (3.3 ), we have 

n^,2(Exp re"") = Exp(?E^2) = exp^^||jc|pj . 

Obviously, this action commutes with the multiplication operator M^. On the other hand, 
applying (2.21) with a = 2 and i = -|, we get 

exp o T^(k) o exp = T^(k) - itM^. 
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Hence, Exp(?E^,) preserves the two-dimensional sub space CM^ + CT^(k), and its action is 
given by the following matrix form 

Expae^)^|j (5.40) 

with respect to the basis {M^, T^(k)}. 
Next, we consider the action 

Qi,2(Exp(?e")) = Exp(ffi^2) = (^^-t) • 

Obviously, it commutes with Dunkl's operator T^{k). On the other hand, applying Lemma 
15.241 2) with ^ = |, we get 

exp (|a^ j oM^o exp (-^AiJ = + itT^ik). 
Hence, Exp(?E^ 2) ^1^° preserves the subspace CM^ + CT^{k), and its action is given as 

Exp^e )^!^^ fj. (5.41) 

Thus, we have proved the first statement. 

2) The center of S L{2, R) consists of the elements Exp(m;7rk) (n e Z) (see (3 .37) ). Let us 
compute the action of Exp(?k) on C| = CM^ + CT^(k). For this, we recall from (|5.27|) that 

Exp(?k) = Co Exp(?h)co' for t e C. 

In view of the formulas (|5.40l) and (j5.4li) . the element cq = Exp i ^ Exp 1 1^ (see 
K25\i ) acts on C| as 



Co 1-^ 

It follows readily from the formula 



1 A /I 0\ /i 1 



l/\^ 1/ U 1 



(Qu(Exp(?h))/) (X) = exp I !lj!^^t I fie'x) 



2 

(see (|5.321) ) that the action on Exp(?h) on C| is given by 

e' 



Exp(?h) ^ Q 



Therefore, Exp(?k) acts on by the formula: 
Exp(?k) 1-^ 



^ i\je' 0W| «V_/cosh(0 -/sinh(0 
{ lj\0 e-')\{ 1/ ~\/sinh(0 cosh(0 

In particular, if t = inn, then Exp(m;rk) acts as (-1)" id on C|. Thus, the action of S L(2, R.) 

descends to 5L(2, R)/2Z ^ 5L(2, R). Then, clearly, this two-dimensional representation 
extends holomorphically to S L{2, C). Hence, the second statement is proved. 
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3) Since a representation of 5L(2, C) is uniquely determined by the generators Exp(?e"^) 
and Exp(?e") {t e C), the third statement follows from (5.40) and ( 5.41.) . □ 

Let ffl be the algebra generated by 

{M^, T^:^eR^}U (£, (5.42) 

where (£ is the Coxeter group. Its defining relations are given by the commutativity of the 
Dunkl operators T^{k) (see (D2) in Section 2), the commutativity of the multiplication oper- 
ators M^, the commutation relations (15.37, ). and the following (£-equivariance: 

h o T^(k) o = Th^{k\ hoM^ohr^ = M,^, for my h e ^ e R^, 

see Em. 

We recall from Proposition 15 .25 1 3) that the matrix representation of the SL(2, C)-action on 
C| = CM^ + CT^{k) does not depend on ^ 6 \ {0}. Then, a simple computation relied on 
(i5.38 ) yields 

[g ■ Uk),g- Tj(k)] = = g- [Uk), Tj(k)l 
[g-Mi,g-Mj]=0 = g-[M^,Mjl 

for any 1 < i,j < N and for any g e S L(2, C). Likewise, we get from (5.37j) 

[g-m),g-Mj] = = g-[Uk),Mjl 

Furthermore, the representation Q.k,a of S L(2, R) commutes with the action of the Coxeter 
group £. Therefore, the action of S L(2, C) on C| (^ 6 R^ \ {0}) and the trivial action on the 
Coxeter group G extends to an automorphism of ffl because all the defining relations of ffl 
are preserved by S L{2, C). 

Hence, we have proved: 

Theorem 5.26. The representation Qjt 2 ofSL(2, R) induces the above action ofSL{2, C) on 
the algebra HI as automorphisms. 

Remark 5.27. As we saw in the proof of Proposition \5.25l the center ofSL(2, C) 

acts on C| as - id. Therefore, PS L(2, C) acts on tH as projective automorphisms. 

In order to compare the 5L(2,Z)-action on TH defined by Cherednik [[6]| we consider the 
following automorphism of 5L(2, C): 

t :5L(2,C)^SL(2,C), ^) ^ (^^ if)' (5-43) 

and twist the 5L(2, C)-action on HI (see Theorem 5.26) by l. This means that the new action 
takes the form 

<^oi:5L(2,C)^GLc(Cj), |^ d)^[-C d]' ^^'"^^^ 
on the generators Cl = CM^ + CT^{k) (see (1539]) ). 
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We write ti and T2 for the automorphisms of tH corresponding to the generators |q | j 

and I J of 5L(2, Z). Then, by ^A^, ti and T2 are given by 

Ti : M^, T^^T^- M^, h^h, 

T2:T^^ T^, M^- T^, h ^ h, 

which coincide with the one given in ||6l. 

Of particular importance in Cherednik Q is the automorphism 

which corresponds to the action of | ^j. The automorphism cr is characterized by 

(t{T^) = -M^, cr{M^) = and (r(h) = h for all h e (£. 

From our view point, these automorphisms on ffl can be obtained as the conjugations of 
the action on the function space (see (5.36 )). In view of the formulas (see (5.43 )): 














!] 


1 =1 


(0 1) 














1 =1 


(:■ % 


'0 




i\ 1 


(0 -i 




0-1 


H 0, 



Exp^yhjy^, 

we may interpret that ti, tj, and cr are given by the conjugations of 

r^,,2(Exp(-/e-^)) = exp(^llxlP), 
Q^,2(Exp(ze~)) = exp(-^Ai), 



:= o exp(^A,) o e^"^"' = exp(iA,) o e^lWI' o exp(iA,) (5.45) 



f^u(Expyh)Qi,2(rE), 



2 

respectively. Recalling the formulas: 



(Q^,2(Exp y hj/)(x) = expl jfiix), 

(Q,,2(r^)/)W = exp(-^^^^^^^4^)(^,,2/)(x), 



we have 

k,2 
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Hence, cr may be interpreted as an algebraic version of the Dunkl transform. We notice that 
the formula (5.45) fits well into Master Formula (5.22) for a = 2, which we may rewrite as 

Ck,2 [ e-'^^^"^^\cxp(-l-AAp)(u)Bka(ix,u)Y]\{a,u)f"du = 
5.7. The uncertainty principle for the transform ^k,a- 

The Heisenberg uncertainty principle may be formulated by means of the so-called Heisen- 
berg inequality for the Euclidean Fourier transform on R.. Loosely, the more a function is 
concentrated, the more its Fourier transform is spread. We refer the reader to an excellent 
survey [|2T| for various mathematical aspects of the Heisenberg uncertainty principle. In this 
section we extend the Heisenberg inequality to the (k, a)-generalized Fourier transform ^k,a 
on R^. 

Let II • \\k be the L^-norm with respect to the measure '&i,aix)dx on (see (|1.2I) '). The goal 
of this subsection is to prove the following multiplicative inequality: 

Theorem 5.28. (Heisenberg type inequality) For all f e L^(R^, '&i, a{x)dx) the (k, a)- generalized 
Fourier transform ^k,a satisfies 



IVIL III ■ t^Uf)l i (5.46) 



The equality holds if and only if the function f is of the form f(x) = /lexp(-c||.\;||'')/or some 
AeC and c e R+. 

Remark 5.29. The inequality (5 ,46^ for k = and a = 2 is the original Heisenberg inequality 
for the Euclidean Fourier transform. The inequality for k > and a = 2 is the Heisenberg 
type inequality for the Dunkl transform, which was proved first by Rosier [51] and then by 
Shimeno [54J. In physics terms we can think of the function f(x) = /lexp(-c||.x;||") where the 
equality holds in the above theorem as a ground state; indeed when a = c = 1, N = 3, and 
k = 0, it is exactly the wave function for the Hydrogen atom with the lowest energy. 

In order to prove Theorem '5.28 we begin with the following additive inequality: 

Lemma 5.30. (1) For all f e L^R^, §kAx)dx) 

\\\\ ■ Pft + llll ■ \\^^Uf)t ^ (2(-t) +N + a- 2)\\f\\l. (5.47) 
(2) The equality holds in (15.471) if and only iff(x) is a scalar multiple of exp(-^||x||"). 
Proof. By Theorem 5.6{3) and Theorem 5.1 [1), we get 

\\\\-P^kaf\\l = mr^k,af,^Kafh 



= -i^k.a{M?'"^kf\^kJ)) 



k 

2~a . 



= -«lU||^-"A,/,/)),. 
Hence, the left-hand side of (15.471) equals 

mW - llxip-A,)/,/)), = «-A,,„/,/)),. (5.48) 
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It then follows from Corollary 3.22 that the self-adjoint operator -A^-q has only discrete 
spectra, of which the minimum is 2{k) + N - 2 + a. Therefore, we have proved 

m^)>a{k)+N-2 + a)\\f\\l. 

Thus, the inequality (5.47) has been proved. Further, the equality holds if and only if / is an 
eigenfunction of -A^. ^ corresponding to the minimum eigenvalue 2{k) + N - 2 + a, namely, 
/ is a scalar multiple of exp(-^||.)c||'') (i.e. by putting = m = in the formula (1.27 ) of 
O^fip, x)). Hence, Lemma 5.30 has been proved. □ 

Proof of Theorem 5.28 Now, for c > 0, we set fdx) := f{cx). Using the fact that the density 
d-k,a is homogeneous of degree 2{k) + a - 2, we get 

l|ll-|lV.|C = c-^^^-™||ll-|lV|t 

and 

ml = c-''''-'-"''\\f\\l. 

Furthermore, we lift the formula in Theorem [5. 9fl) to the formula 

{^kjc){x) = c-(^-2<^>-2)(^,,,/)(^), 

from which we get 

Thus, if we substitute fc for / in Lemma 5.30, we obtain 

c'ill • 11^/11' + chilli • \\^-^kAf)\\l > a{k) +N + a- 2)\\f\\l. 
Obviously the minimum value of the left-hand side (as a function of c e R+) is 

2||ii-iiMLIIiMi^^u/)|L. 

Hence, Theorem [5.28l has been proved. □ 
(Acknowledgement) 

It is a great pleasure to thank C. Dunkl and E. Opdam for their valuable comments on a very 
preliminary version of this paper. The second author is partially supported by Grant-in- Aid 
for Scientific Research (B) (18340037), Japan Society for the Promotion of Science, Harvard 
University, Max Planck Institut fiir Matehmatik, and the Alexander Humboldt Foundation of 
Germany. 

References 

[1] G. Andrews, R. Askey and R. Roy, Special Functions, Cambridge, 1999. 

[2] S. Ben Said, On the integrability of a representation of 5l(2, R), J. Funct. Anal. 250 (2007), 249-264. 
[3] S. Ben Said, T. Kobayashi and B. 0rsted, Generalized Fourier Transforms J^k,a, C. R. Acad. Sci. Paris 
Ser. I Math, (to appear) 

[4] S. Ben Said and B. 0rsted, The wave equation for Dunkl operators, Indag. Math. (N.S.) 16 (2005), 351- 
391. 

[5] S. Ben Said and B. 0rsted, Segal-Bargmann transforms associated with finite Coxeter groups. Math. Ann. 
334 (2006), 281-323. 

[6] I. Cherednik, Macdonald's evaluation conjectures and difference Fourier transform. Invent. Math. 122 
(1995), 119-145. 



70 



SALEM BEN SAID, TOSHIYUKI KOBAYASHI, AND BENT 0RSTED 



[7] I. Cherednik and Y. Markov, Hankel transform via double Hecke algebra, Iwahori-Hecke algebras and 

their Representation Theory (Martina-Franca, 1999), M. W. Baldoni and D. Barbasch (eds.), Lecture Notes 

in Math. 1804, Springer- Verlag, Berlin, 2002, 1-25. 
[8] L. Debnath and D. Bhatta, Integral transforms and their applications. Second Edition, Chapman & 

Hall/CRC, Boca Raton, FL, 2007. 
[9] C. F. Dunkl, Reflection groups and orthogonal polynomials on the sphere, Math. Z. 197 (1988), 33-60. 
[10] C. F. Dunkl, Differential-difference operators associated to reflection groups, Trans. Amer. Math. Soc. 311 

(1989), 167-183. 

[11] C. F. Dunkl, Integral kernels with reflection group invariance, Canad. J. Math. 43 (1991), 1213-1227. 
[12] C. F. Dunkl, Hankel transforms associated to finite reflection groups, Proc. of the special session on hy- 

pergeometric functions on domains of positivity. Jack polynomials and applications. Proceedings, Tampa 

1991, Contemp. Math. 138 (1992), 123-138. 
[13] C. F. Dunkl, Intertwining operators associated to the group S3, Trans. Amer. Math. Soc. 347 (1995), 

3347-3374. 

[14] C. F. Dunkl, A Laguerre polynomial orthogonality and the hydrogen atom. Anal. Appl. (Singap.) 1 (2003), 
177-188. 

[15] C. F. Dunkl, Reflection groups in analysis and applications, Japan. J. Math. (3rd ser.) 3 (2008), 215-246. 
[16] C. F. Dunkl and Y. Xu, Orthogonal Polynomials of Several Variables, Cambridge University Press, Cam- 
bridge, 2001. 

[17] C. F. Dunkl, M. de Jeu and E. Opdam, Singular polynomials for flnite reflection groups. Trans. Amer. 

Math. Soc. 346 (1994), 237-256. 
[18] P. Etingof, A uniform proof of the Macdonald-Mehta-Opdam identity for finite Coxeter groups, arXiv 

0903.5084 

[19] P. Etingof and V. Ginzburg, Symplectic reflection algebras, Calogero-Moser space, and deformed Harish- 

Chandra homomorphism. Invent. Math. 147 (2002), 243-348. 
[20] G. B. FoUand, Harmonic Analysis in Phase Space, Ann. of Math. Stud. 122, Princeton University Press, 

Princeton, NJ, 1989. 

[21] G. B. Folland and A. Sitaram, The uncertainty principle: a mathematical survey, J. Fourier Anal. Appl. 3 

(1997), 207-238. 

[22] L. Gallardo and M. Yor, A chaotic representation property of the multidimensional Dunkl processes Ann. 
Probab. 34 (2006), 1530-1549. 

[23 1 I. M. Gelfand and S. G. Gindikin, Complex manifolds whose spanning trees are real semisimple Lie groups, 
and analytic discrete series of representations, Funct. Anal. Appl. 11 (1977), 19-27. 

[24] I. S. Gradshteyn and I. M. Ryzhik, Table of Integrals, Series, and Products, Corrected and enlarged edi- 
tion edited by Alan Jeffrey. Incorporating the fourth edition edited by Yu. V. Geronimus and M. Yu. 
Tseytlin. Translated from the Russian. Academic Press [Harcourt Brace Jovanovich, Publishers], New 
York-London-Toronto, Ont., 1980. 

[25] G. J. Heckman, A remark on the Dunkl differential-difference operators, Harmonic Analysis on Reductive 
Groups, (eds. W. Barker and P Sally), Progr Math. 101, Birkhauser, 1991, 181-191. 

[26] S. Helgason, Groups and Geometric Analysis, Academic Press, New York, 1984. 

[27] J. E. Humphreys, Reflection Groups and Coxeter Groups, Cambridge Stud. Adv. Math. 29, Cambridge 

University Press, Cambridge, 1990. 
[28] J. Hilgert and K-H. Neeb, Lie Semigroups and their Applications, Lecture Notes in Math. 1552, Springer- 

Verlag, Berhn, 1993. 

[29] J. Hilgert and K-H. Neeb, Positive definite spherical functions on Olshanski domains. Trans. Amer. Math. 

Soc. 352 (2000), 1345-1380. 
[30] R. Howe, On the role of the Heisenberg group in harmonic analysis. Bull. Amer. Math. Soc. (N.S.) 3 

(1980), 821-843. 

[31] R. Howe, The oscillator semigroup. The Mathematical Heritage of Hermann Weyl (Durham, NC, 1987), 
R. O. Wells, Jr. (ed.), Proc. Sympos. Pure Math. 48, Amer. Math. Soc, Providence, RI, 1988, 61-132. 



LAGUERRE SEMIGROUP AND DUNKL OPERATORS 



71 



[32] R. Howe and E.-C. Tan, Nonabelian Harmonic Analysis. Applications ofSL(2,R), Universitext, Springer- 
Verlag, New York, 1992. 

M. F. E. de Jeu, The Dunkl transform. Invent. Math. 113 (1993), 147-162. 

M. F. E. de Jeu, Paley-Wiener theorems for the Dunkl transform. Trans. Amer. Math. Soc. 358 (2006), 
4225-4250. 

A. W. Knapp and D. A. Vogan, Jr., Cohomological Induction and Unitary Representations, Princeton 
University Press, 1995. 

T. Kobayashi, Discrete decomposability of the restriction ofA^{A) with respect to reductive subgroups and 
its applications. Part I Invent. Math. 117 (1994), 18 1-205 ; rParnil Ann. of Math. 147 (1998), 709-729; 
Part III Invent. Math. 131 (1998), 229-256. 

T. Kobayashi, Discretely decomposable restriction of unitary representations of reductive Lie groups, — 
examples and conjectures. Advanced Studies in Pure Mathematics 26 (2000), 99-127. 
T. Kobayashi and G. Mano, Integral formulas for the minimal representations for 0{p, 2)|, Acta Appl. 
Math. 86 (2005), 103-1 13. 

T. Kobayashi and G. Mano, The inversion formula and holomorphic extension of the minimal representa- 
tion of the conformal group. Harmonic Analysis, Group Representations, Automorphic Forms and Invari- 
ant Theory: In honor of Roger Howe, (eds. J. S. Li, E. C. Tan, N. Wallach and C. B. Zhu), World Scientific, 
2007, 159-223 (cf.|matERT/0607007) ). 

T. Kobayashi and G. Mano, Integral formula of the unitary inversion operator for the minimal represen- 
tation ofOip, q), Proc. Japan Acad. Ser. A 83 (2007), 27-31; the full paper, iv + 167pp. (to appear in the 
Mem. Amer. Math. Soc.) is available at arXi v:0712.1769l 

T. Kobayashi and B. 0rsted, Analysis on the minimal representation ofO{p, q). II. Branching laws Adv. 
Math. 180 (2003), 513-550. 

B. Kostant, On Laguerre polynomials, Bessel functions, and Hankel transform and a series in the unitary 
dual of the simply-connected covering group ofSL{2, R), Represent. Theory 4 (2000), 181-224. 
S. Lang, S LiiW), Reprint of the 1975 edition. Graduate Texts in Mathematics, 105. Springer- Verlag, New 
York, 1985. 

I. G. Macdonald, Some conjectures for root systems, SIAM J. Math. Anal. 13 (1982), 988-1007. 
G. Mano, A continuous family of unitary representations with two hidden symmetries — an example, RIMS 
Kokyuroku Bessatsu, Representation Theory and Analysis on Homogeneous Spaces (Conference Proceed- 
ings at RIMS, 2006 August), H. Sekiguchi (ed.), 2008, 137-144 (in Japanese). 
E. Nelson, A«flfyf/c vectors, Ann. of Math. 70 (1959), 572-615. 

E. Opdam, Dunkl operators, Bessel functions and discriminant of a finite Coxeter group, Comp. Math. 85 
(1993), 333-373. 

G. Olshanski, Invariant cones in Lie algebras. Lie semigroups and the holomorphic discrete series, Funct. 
Anal. Appl. 15 (1981), 275-285. 

R. Ranga Rao, Unitary representations defined by boundary conditions — the case of sl(2, R), Acta Math. 
139(1977), 185-216. 

M. Rosier, Positivity ofDunkl's intertwining operator, Duke Math. J. 98 (1999), 445^63. 
M. Rosier, An uncertainty principle for the Dunkl transform. Bull. Austral. Math. Soc. 59 (1999), 353-360. 
M. Rosier and M. Voit, Markov processes related with Dunkl operators. Adv. in Appl. Math. 21 (1998), 
575-643. 

M. Sato, Theory of hypeif unctions I, J. Fac. Sci. Univ. Tokyo, 8 (1959), 139-193. 

N. Shimeno, A note on the uncertainty principle for the Dunkl transform, J. Math. Sci. Univ. Tokyo 8 
(2001), 33^2. 

R. J. Stanton, Analytic extension of the holomorphic discrete series, Amer J. Math. 108 (1986), 1411- 
1424. 

S. Thangavelu and Y. Xu, Generalized translation and convolution operator for Dunkl transform, J. 
d' Analyse Mathematique 97 (2005), 25-56. 

S. Thangavelu and Y. Xu, Riesz transform and Riesz potentials for Dunkl transform J. Comput. Appl. 
Math. 199 (2007), 181-195. 



72 



SALEM BEN SAID, TOSHIYUKI KOBAYASHI, AND BENT 0RSTED 



[58] K. Trimeche, Paley-Wiener theorems for the Dunkl transform and Dunkl translation operators, Integral 

Transforms Spec. Funct. 13 (2002), 17-38. 
[59] M. Vergne, On Rossmann's character formula for discrete series, Invent. Math. 54 (1979), 11-14. 
[60] N. Ja. Vilenkin, Special Functions and the Theory of Group Representations, Translated from the Russian 

by V. N. Singh, Transl. Math. Monogr. 22, Amer. Math. Soc, Providence, RI, 1968. 
[61] A. Weil, Sur certains groupes d'operateurs unitaires, Acta Math. Ill (1964), 143-211. 
[62] Z. X. Wang, and D. R. Guo, Special Functions, Translated from the Chinese by Guo and X. J. Xia, World 

Scientific Pubhshing Co., Inc., Teaneck, NJ, 1989. 
[63] Y. Xu, Funk-Hecke formula for orthogonal polynomials on spheres and on balls. Bull. London Math. Soc. 

32 (2000), 447-457. 

[64] Y. Xu, Orthogonal polynomials for a family of product weight functions on the spheres, Canad. J. Math. 
49 (1997), 175-192. 



List of Symbols 



TiW),M 
AkM 
Am, El 



^k,a, 30] 

r,,27,32] 
Mx), 12] 

&kAx)M 

Ak,a,mM 

7r(A), 28] 



^-t,m(w,77),|4S] 



k, 18 



nM8] 
n , 18] 



VkM 



^k,a,.m. 



:'^),|23] 



C(G), "27] 
C;(f), 39] 
C+, 32 
C++, 32] 

e, 4, 11] 

'^v.n, 41] 

Ci:,a,l45] 

4,[14] 
^i,l2] 

£,1111 



E7 ,TB] 

e+,16 

e-,|l6| 

^k,aMM 

HM,in] 

h,a(r,s;z;t),M 
h,|16, 




m 
m 



73 



74 



SALEM BEN SAID, TOSHIYUKI KOBAYASHI, AND BENT 0RSTED 



S. Ben Said: Universite Henri Poincare-Nancy 1, Institut Eue Cartan, Departement de Mathematiques, 
B.P. 239, 54506 Vandoeuvre-Les-Nancy, Cedex, France 
E-mail address: Salem. BenSaid@iecn.u-nancy . fr 

T. KoBAYASHi: the Untversity of Tokyo, Graduate School of MATHEMAncAL Sciences, 3-8-1 Komaba, Me- 
GURO, Tokyo, 153-8914, Japan; (current address: Max Planck Institut fur Mathematik, Vivatgasse 7, D- 
53111 Bonn, Germany.) 

E-mail address: toshiOms . u-tokyo . ac . jp 

B. 0RSTED: University of Aarhus, Department of Mathematical Sciences, Building 530, Ny Munkegade, 
DK 8000, Aarhus C, Denmark 

E-mail address: orsted@imf.au.dk 



